Questions tagged [performance]

Performance concerns how effectively a computing system uses resources.

Filter by
Sorted by
Tagged with
2 votes
0 answers
56 views

PostGIS slow performances on small table and basic SELECT query

A few weeks ago, I received a query to install a PostGIS database for a few of my users. I'm not familiar with this but yet installed quite simply the extension using the sudo apt install postgresql-...
WebManiaK's user avatar
0 votes
1 answer
130 views

QGIS and remote PostgreSQL/PostGIS (in cloud) slow performance

I am using QGIS 3.28.11 version and in backend I am using PostgreSQL 15.0 with PostGIS 3.3.3. I have total 36 layers which contained in 3 groups: A, B, C. Now X user has read only access on all layers ...
Rajesh Kumar's user avatar
3 votes
1 answer
70 views

Find all geometries in one table that do not exist in another

Using PostgreSQL and PostGIS, I have two tables of polygons, and I need to know which of the records in table p1 do not exist in table p2. I do not have additional information available (e.g. ids) - ...
susie derkins's user avatar
0 votes
1 answer
119 views

Prevent sending too many requests while zooming/paning (OpenLayers 6.15)

I have a web page that displays WMS data from a WMS server, using a TileLayer. The images are fetched with a callback function called by the setTileLoadFunction(..) method of the associated TileWMS ...
Kadjoe's user avatar
  • 1
3 votes
0 answers
97 views

Speed up a query using ST_Within and ST_PointOnSurface

CREATE TABLE municipal_area ( id varchar NOT NULL, "name" varchar NOT NULL, state_id varchar NOT NULL, state_abbr varchar NOT NULL, state_name varchar NOT NULL, ...
jcollum's user avatar
  • 153
0 votes
1 answer
68 views

Can I utilize vectorization to improve performance instead of iterating over QGIS Features?

I am using Python to write a standalone application with QGIS. The application uses requests to allow the user to update a shapefile from the internet on demand. After fetching the shapefile, I need ...
Zach Longhofer's user avatar
3 votes
1 answer
116 views

QGIS Speed up slow virtual layer

In QGIS I have a virtual layer which does a line generation based on a point shape. The point shape has about 700 point geometries and 26 attribute fields. SELECT a.Name, a.FromNode, a.ToNode, a....
MtoK's user avatar
  • 61
1 vote
0 answers
49 views

Poor cache hit ratio for spatial tables

Most PostgreSQL tuning guides introduce the cache hit ratio as a metric to find out if PostgreSQL has enough heap space to cache data and reduce heavy disk i/o. To get a hit ratio for a certain table ...
Jürgen Zornig's user avatar
0 votes
0 answers
282 views

Slow performance of ST_AsMVT for huge PostGIS database

I am fetching MVT tiles from a PostGIS database in combination with pg_tileserve. When fetching tiles from a fairly small dataset (some 10000 features) this works quite performant. But when fetching ...
tile_consumer's user avatar
1 vote
1 answer
62 views

Browser hangs while parsing georaster in geoblaze

I've been trying to create a histogram using geoblaze with a COG from s3. The georaster is as follows: (generated with geoblaze.parse(url)) { _data: '==hidden==', projection: 32618, height: ...
Snape's user avatar
  • 11
1 vote
0 answers
67 views

Improving performance when loading data in current Map using ArcGIS Pro SDK and C#

I want to load data into a current map in ArcGIS Pro 2.9. For this purpose, I want to use a .lyrx file. Currently, I have implemented it with: Uri uriLayerPath = new Uri(strLayerPath); LayerFactory....
Stephan's user avatar
  • 11
1 vote
0 answers
49 views

Speeding up QGIS Processing - Plugin [closed]

I am trying to calculate the angular integration and angular choice of a nationwide road network (Line SHP). PST does the job, however it uses ALL (and by that I mean 100%) of my CPU's cores, but does ...
JHP's user avatar
  • 11
0 votes
0 answers
47 views

Time to list all schemas of PostgreSQL with QGIS 3

QGIS 3.18 PostgreSQL 14. We use QGIS to access data from a PostGIS server. The data are stored in 33 schemas. one contains all the data in 17 tables; the others schemas contain views and materialized ...
Leehan's user avatar
  • 1,216
1 vote
0 answers
84 views

QgsGeometry.fromWkt() seems weirdly slow compared to OSGeo/Shapely

wkt = 'LineString (64763.65372879413189366 5532941.864832429215312, 64811.82167246036988217 5533046.30194362625479698, 64827.02791490274103126 5533082.7359510725364089, 64833.97425112823839299 5533108....
Kalak's user avatar
  • 3,693
0 votes
1 answer
183 views

Faster way to compute Moran’s Index from a very large distance matrix between geographic points

I am computing Moran’s Index from a very large distance matrix between geographic points. The time to execute the code is too high. I used the dism function in the geosphere package. Here a ...
Pierre's user avatar
  • 395
3 votes
2 answers
127 views

Improving ST_Intersects performance in PostGIS

I have the following query, but it takes a long time to run. I tried creating an index, but there hasn't been much improvement. Any suggestions? CREATE INDEX temp_clusters_geom_idx ON temp_clusters ...
user3222101's user avatar
3 votes
0 answers
97 views

Why is it slow when deleting features in gpkg using PyQGIS?

Deleting features in a somewhat big GeoPackage takes a really long time and I am not sure if I do something wrong or if it is normal that it takes such a long time. Data: line GeoPackage layer ...
Kalak's user avatar
  • 3,693
10 votes
1 answer
183 views

Explaining long computing time of Python code

I have a Python code adding information to a layer if its features are overlayed by other features. The base layer has 1200 features and is 10 MB. The 4 layers for the overlay have roughly 40 MB ...
MrSalamikuchen's user avatar
0 votes
0 answers
77 views

Huge layer takes too long to load and it's hindering my workflow

I have a huge point shapefile of InSAR data, on the heighs of 300k+ points in a single shapefile, over a large area. My workflow consists in manually checking and ensuring the quality of some points; ...
user218084's user avatar
1 vote
0 answers
39 views

Difference in performance executing process on layer from project or file

Is there any difference between loading layer into processing algorithm from file or from current project? I have a custom processing algorithm which crashes QGIS (depending on the machine - ...
Kubson's user avatar
  • 602
1 vote
0 answers
126 views

Is there a faster approach to change a data type on a feature class field in ArcGIS Pro 2.9.5?

I've followed the "Calculate Field Tool" steps from this article https://support.esri.com/en/technical-article/000023089 to change the data type on a field but it takes so long to copy the ...
Allex Santana's user avatar
1 vote
1 answer
221 views

Better workflow for extracting boundary of raster in QGIS

I have got a raster (.tif) which has areas with "no data". I want to extract just the area where i have data. I can do this with gdal:polygonize (1) and native:dissolve (2). But especially ...
fsg's user avatar
  • 672
1 vote
0 answers
108 views

Speed up intersection on large polygons with PyQGIS?

Is there a way to speed up my script? I am new to PyQGIS. I am using QGIS 3.16. What I need: I have 50 polygons (up to 1.675.000 hectares, mean 420.000 ha; one shapefile per polygon) and for each of ...
Pompoensoep's user avatar
0 votes
1 answer
137 views

Updating 3 million rows in file geodatabase

I have a GDB which has 3 million annotation data, then I would like to modify some filed values based on csv table I'm using the following ArcPy scripts now, but it's too slow import arcpy import ...
icye's user avatar
  • 9
3 votes
1 answer
254 views

PostgreSQL not taking full advantage of all computing resources

Basically I have one table buildings_by_cell_300m, About 2490000 rows. I want to statistic all the geom information within 50 meters of each geom. I am doing: CREATE TABLE gbmi.bn_by_cell_300m AS ( ...
yougao's user avatar
  • 45
4 votes
0 answers
203 views

Reducing loading time of QGIS project

I have saved a couple of QGIS projects in a PostGIS DB, which is hosted in the cloud. The projects consist of different layers. When I open the QGIS projects, the loading time is very long. That is a ...
Enzo Baldini's user avatar
  • 2,297
1 vote
0 answers
177 views

ST_Intersection R(sf) Projected vs Geographic data. Significant performance difference [closed]

I'm working with OpenStreetMap (OSM) road networks for US States. I read all the roads for a state, then clip the roads to the state boundary layer using the boundary from tigris::states(). The OSM ...
Navaguesser's user avatar
0 votes
2 answers
354 views

GeoServer WMTS- GetCapabilities request Filter

We have 100 + GeoTIFF layers which we have to display in the front end via OpenLayers. We use WMTS protocol to fetch data. The initial request "hostname/gwc/service/wmts?REQUEST=GetCapabilities&...
BharathyKannan's user avatar
3 votes
1 answer
464 views

Speeding up the import of DXF files in QGIS

I have to import several DXF-Files into QGIS and load them into a database. The files are quite big, around 20 MB or 30 MB large. I started to import the first DXF-File several hours ago and it is ...
Enzo Baldini's user avatar
  • 2,297
0 votes
0 answers
20 views

Slow upload time in PostGIS [duplicate]

I have a csv file of 144 millions different points with latitude and longitude values. Using the following SQL statement, it currently takes me more than 24 hours to upload the data: CREATE TABLE pts(...
Ian Moffit's user avatar
0 votes
0 answers
99 views

Improve speed of query with st_dump(multipolygon)

My query has lost a lot of performance only when I add st_dump do split multipolygon. When I add st_dump, the query spent 4 minutes against without it has run in 38s. What can I do to improve ...
Diogo Caribé's user avatar
1 vote
0 answers
590 views

Efficiently export very large attribute table in ArcGIS Pro

My attribute table is 481'000'000 lines long over 8 columns resulting in approx 38GB as a CSV File. During the Export it got, however, insanely slow after reaching 95%. I, therefore, am looking for a ...
Yves's user avatar
  • 326
2 votes
1 answer
102 views

Seeking faster alternative to arcpy.Statistics_analysis?

I'm using arcpy.Statistics_analysis to count records and it takes about 30/35min for a table with about 6.8 million records, in a bigger script, this is a big chunk of the whole time. The result of ...
FTeixeira's user avatar
2 votes
0 answers
174 views

Improving performance of spatial intersection and aggregation query

Edit: Per a comment, here is some more context and the basics of what I'm looking to do, that I think would better enable someone to offer input from a first principles perspective. Its a lot of ...
mtreg's user avatar
  • 292
1 vote
0 answers
106 views

Limiting saga_cmd memory usage

I'm trying to perform a shrink operation on a large (13GB LZW compressed) raster in SAGA GIS on Linux: saga_cmd grid_tools 28 -INPUT in.tif -RESULT out.tif -OPERATION 0 -RADIUS 5 I have 64GB of RAM +...
kontextify's user avatar
0 votes
0 answers
100 views

Improving performance of Overpass area search queries

I am building an application that retrieves lists of location names within geographical boundaries like cities and postal codes. The queries take up to 15 seconds to complete and I would like to make ...
Sarge's user avatar
  • 1
2 votes
1 answer
68 views

Optimizing arcpy UpdateCursor on large Polygon Feature Class and Table

I'm attempting to update a numeric field using an arcpy.da.UpdateCursor. I'm applying the update to a Feature Layer and Table, which participate in a One to Many Relationship. The Feature layer is ...
vitale232's user avatar
  • 131
0 votes
0 answers
92 views

Build Network performance using ArcGIS Pro

I'm using ArcGIS Pro 2.8 and have access to the Network Analyst extension. I'm new to the Network Analyst tools and I have been following the Create A Network Dataset tutorial using my own data. I ...
user209014's user avatar
5 votes
1 answer
135 views

Efficient way to compare fields or expressions of intersecting features: bulk-loading vs. get features one-by-one

I want to find an efficient (especially in terms of memoryusage and processing speed) method to compare intersecting features by attribute/expression. For this script I am iterating over a ...
MrXsquared's user avatar
  • 33.8k
0 votes
1 answer
642 views

Improving ArcGIS Pro performance on virtual desktop

I use ArcGIS Pro remotely and use a virtual desktop. I noticed the software works extremely slowly and would take time to load changes on my map. I took a look at the CPU and memory utilization. My ...
Chagii's user avatar
  • 9
2 votes
1 answer
260 views

Speeding up the process of aggregate function in QGIS

I'm conducting aggregate function in QGIS. But since the feature number is high, the process is very slow. Is there a way to speed up the calculation process? By using this function: sum("lengths&...
Eren E's user avatar
  • 143
1 vote
0 answers
223 views

Geoserver Performance Bootleneck in Docker - Response Time is very high

I am using GeoServer 2.20.4 & Tomcat9.0.62 version in live environment with Docker. Sometimes I have performance issues. I'm investigating the reason for this. The server has 24gb RAM. It can use ...
mahmudao2325's user avatar
0 votes
0 answers
252 views

GeoServer + PostGIS performance

Testing a GeoServer performance. Using a Kartoza docker image and data is under AWS RDS instance for PostgreSQL. The size of the PostgreSQL materialized view is Size 3,666 MB. Spatial indexes and ...
shailesh gavathe's user avatar
1 vote
1 answer
245 views

How big geometry are best for BigQuery performance

I make a geospatial analysis, in Google BigQuery, which mostly includes making difference (I mean ST_Difference) between parcels geometry and some objects like woods, buildings etc. Some of objects I ...
Jurek's user avatar
  • 19
1 vote
0 answers
210 views

Get map to use function-based spatial index (ST_GEOMETRY)

SDE.ST_GEOMETRY — Oracle 18c — ArcMap/EGDB 10.7.1: I have a view that returns the startpoint of lines as an ST_GEOMETRY column: create or replace view bc_atn_startpoint_vw as ( select objectid, ...
User1974's user avatar
  • 1,122
3 votes
1 answer
369 views

Clipping large shapefile in QGIS

I am working on a large shapefile sourced from https://www.iucnredlist.org/resources/spatial-data-download. I cannot clip Fish and Plants (global file) in Freshwater groups species to a smaller extent ...
rgt's user avatar
  • 107
1 vote
1 answer
215 views

Geoserver WFS-T performance degraded after upgrading to 2.20

After upgrading from GeoServer 2.16.1 to 2.20.4 we noticed that large WFS-T requests are getting stuck. We have a JS OpenLayers client that sends inserts/updates/deletes via WFS-T in chunks of 50 ...
b9s's user avatar
  • 121
2 votes
1 answer
232 views

Improve performance of startpoint query (ST_GEOMETRY)

I have a SDE.ST_GEOMETRY query in an Oracle 18c EGDB that gets the startpoint of polylines: select objectid, sde.st_geomfromwkb(sde.st_asbinary(sde.st_startpoint(sde.st_geometryn(shape,1))), ...
User1974's user avatar
  • 1,122
1 vote
1 answer
527 views

QGIS only using one core

I am using QGIS 3.24.2 Tisler. Machine is an i9-7900 @3.30 Ghz 64 GB RAM using Windows 11 64bit. Disk is SSD and Gfx card is a RTX2060he When doing a raster merge (Raster - misc - merge) of multiple ...
Richard Cutts's user avatar
1 vote
0 answers
150 views

PostGIS/PostgreSQL Heavy performance issues with SUM

Not sure if this is specific of GIS stuff or simply a SQL performance issue, but due to the nature of the issue and that I am working with H3 data types here it goes I have a query that runs very ...
SeekanDestroy's user avatar

1
2 3 4 5
15