Questions tagged [performance]
Performance concerns how effectively a computing system uses resources.
742
questions
0
votes
1
answer
545
views
Improving ArcGIS Pro performance on virtual desktop
I use ArcGIS Pro remotely and use a virtual desktop. I noticed the software works extremely slowly and would take time to load changes on my map. I took a look at the CPU and memory utilization. My ...
CommunityBot
- 1
7
votes
1
answer
1k
views
Improving speed of GeoPandas dissolve
I am trying to dissolve grid spaces by category using GeoPandas' dissolve function, but it doesn't finish after hours of running and I want to make sure I'm not doing something wrong and/or there isn'...
- 31.4k
2
votes
1
answer
55
views
Find all geometries in one table that do not exist in another
Using PostgreSQL and PostGIS, I have two tables of polygons, and I need to know which of the records in table p1 do not exist in table p2. I do not have additional information available (e.g. ids) - ...
- 29.4k
1
vote
1
answer
533
views
Making looping through line segments for vertex points faster?
I am trying to speed up some current code that I have for looping through lines, getting their segments and ultimately the vertex points in Python.
Can anyone recommend a faster method than what I ...
CommunityBot
- 1
0
votes
1
answer
63
views
Prevent sending too many requests while zooming/paning (OpenLayers 6.15)
I have a web page that displays WMS data from a WMS server, using a TileLayer. The images are fetched with a callback function called by the setTileLoadFunction(..) method of the associated TileWMS ...
- 19.9k
3
votes
0
answers
83
views
Speed up a query using ST_Within and ST_PointOnSurface
CREATE TABLE municipal_area (
id varchar NOT NULL,
"name" varchar NOT NULL,
state_id varchar NOT NULL,
state_abbr varchar NOT NULL,
state_name varchar NOT NULL,
...
- 153
3
votes
1
answer
88
views
QGIS Speed up slow virtual layer
In QGIS I have a virtual layer which does a line generation based on a point shape. The point shape has about 700 point geometries and 26 attribute fields.
SELECT a.Name, a.FromNode, a.ToNode, a....
- 61
1
vote
0
answers
17
views
Can I utilize vectorization to improve performance instead of iterating over QGIS Features?
I am using Python to write a standalone application with QGIS. The application uses requests to allow the user to update a shapefile from the internet on demand. After fetching the shapefile, I need ...
1
vote
1
answer
161
views
How to do non-blocking OWS requests in Python?
Is it possible to use OWSLib with aiohttp?
Is there a Python library for formatting/parsing WPS (and other OGC web services, such as WMS - web map service) requests, that also supports IO coroutines (...
CommunityBot
- 1
0
votes
1
answer
4k
views
Speeding up Google Geocoding API Slow performance
I am using Google geocoding API service with their Java client, and my dev Key,
The problem is when I run up to 40 requests it does slow to 600ms. I am using it in a webservice that is supposed to run ...
CommunityBot
- 1
1
vote
0
answers
38
views
Poor cache hit ratio for spatial tables
Most PostgreSQL tuning guides introduce the cache hit ratio as a metric to find out if PostgreSQL has enough heap space to cache data and reduce heavy disk i/o. To get a hit ratio for a certain table ...
- 19.9k
47
votes
7
answers
12k
views
Tuning PostGIS for production environments
What PostGIS documentation have you come across that has been helpful when tuning PostGIS for a production environment?
I would like to get together with my DBA to setup a Postgresql/PostGIS ...
- 65k
6
votes
2
answers
363
views
Stop Virtual Layer from automatically recalculation in QGIS
QGIS's Virtual Layer has big performance impact. Even when panning or zooming in the canvas, a virtual layer could take seconds to minutes to refresh. From my speculation, the reason might be the ...
- 31.4k
0
votes
0
answers
167
views
Slow performance of ST_AsMVT for huge PostGIS database
I am fetching MVT tiles from a PostGIS database in combination with pg_tileserve.
When fetching tiles from a fairly small dataset (some 10000 features) this works quite performant.
But when fetching ...
1
vote
1
answer
44
views
Browser hangs while parsing georaster in geoblaze
I've been trying to create a histogram using geoblaze with a COG from s3.
The georaster is as follows: (generated with geoblaze.parse(url))
{
_data: '==hidden==',
projection: 32618,
height: ...
- 19.9k
13
votes
2
answers
5k
views
Lots of layers in one or multiple services? (and why)
Scenario:
Client has a web mapping application. Does not want to split into multiple smaller applications. Although this goes against what the modern day approach is for maps on the web, (i.e. ...
- 65k
1
vote
0
answers
58
views
Improving performance when loading data in current Map using ArcGIS Pro SDK and C#
I want to load data into a current map in ArcGIS Pro 2.9. For this purpose, I want to use a .lyrx file. Currently, I have implemented it with:
Uri uriLayerPath = new Uri(strLayerPath);
LayerFactory....
- 65k
4
votes
0
answers
2k
views
Clustering table on geohash index and geohash ordered table [closed]
Could there be a performance gain by reorganizing the rows in a table by Geohash and then CLUSTERing this table on the Geohash index of the geometries?
CREATE TEMPORARY TABLE tmptbl AS
SELECT *, (...
- 65k
1
vote
0
answers
47
views
Speeding up QGIS Processing - Plugin [closed]
I am trying to calculate the angular integration and angular choice of a nationwide road network (Line SHP).
PST does the job, however it uses ALL (and by that I mean 100%) of my CPU's cores, but does ...
- 65k
0
votes
0
answers
45
views
Time to list all schemas of PostgreSQL with QGIS 3
QGIS 3.18 PostgreSQL 14.
We use QGIS to access data from a PostGIS server. The data are stored in 33 schemas.
one contains all the data in 17 tables;
the others schemas contain views and materialized ...
- 19.9k
3
votes
1
answer
334
views
Clipping large shapefile in QGIS
I am working on a large shapefile sourced from https://www.iucnredlist.org/resources/spatial-data-download. I cannot clip Fish and Plants (global file) in Freshwater groups species to a smaller extent ...
- 31.4k
13
votes
3
answers
9k
views
Poor Performance when using Spatial Indexes in MySQL
Re-post of a question asked on Stack Overflow when it was suggested this would be a better forum.
I'm trying a little experiment at pushing a data set which is not geo-spatial but fits it quite well ...
CommunityBot
- 1
0
votes
1
answer
158
views
Faster way to compute Moran’s Index from a very large distance matrix between geographic points
I am computing Moran’s Index from a very large distance matrix between geographic points. The time to execute the code is too high. I used the dism function in the geosphere package.
Here a ...
- 65k
1
vote
0
answers
67
views
QgsGeometry.fromWkt() seems weirdly slow compared to OSGeo/Shapely
wkt = 'LineString (64763.65372879413189366 5532941.864832429215312, 64811.82167246036988217 5533046.30194362625479698, 64827.02791490274103126 5533082.7359510725364089, 64833.97425112823839299 5533108....
- 3,342
3
votes
2
answers
122
views
Improving ST_Intersects performance in PostGIS
I have the following query, but it takes a long time to run. I tried creating an index, but there hasn't been much improvement. Any suggestions?
CREATE INDEX temp_clusters_geom_idx
ON temp_clusters
...
- 65k
9
votes
0
answers
302
views
Performance-limits of QGIS expressions
I use quite often QGIS expressions and I am wondering how performant they are compared with other possibilities. In many cases, the same problem can be resolved using different approaches like using ...
- 659
12
votes
2
answers
6k
views
Shapely with Rtree versus STRtree
I have a huge interrogation regarding the performance difference between Rtree and STRtree included in Shapely. Below is a short code where we create randomly 250 000 triangles (defined by 4 vertice) ...
- 2,962
3
votes
0
answers
77
views
Why is it slow when deleting features in gpkg using PyQGIS?
Deleting features in a somewhat big GeoPackage takes a really long time and I am not sure if I do something wrong or if it is normal that it takes such a long time.
Data: line GeoPackage layer ...
- 3,342
10
votes
1
answer
181
views
Explaining long computing time of Python code
I have a Python code adding information to a layer if its features are overlayed by other features. The base layer has 1200 features and is 10 MB. The 4 layers for the overlay have roughly 40 MB ...
- 1,075
7
votes
2
answers
507
views
Faster calculation of cumulative sum in attribute table in QGIS
I have a shapefile attribute table in QGIS that I would like to calculate the cumulative sum. The thing is that it has over 1.5 million features.
Type of device: HDD.
The attribute table looks like ...
- 31.4k
4
votes
2
answers
777
views
PostGIS geocoder size and performance
I have installed PostgreSQL 9.3.5 and PostGIS 2.1.2 on a 16Gb Ubuntu 14.04 system.
If I load all the states' TIGER data, using the scripts provided in Postgis, how big will the database be for the ...
- 19.9k
2
votes
1
answer
218
views
Improve performance of startpoint query (ST_GEOMETRY)
I have a SDE.ST_GEOMETRY query in an Oracle 18c EGDB that gets the startpoint of polylines:
select
objectid,
sde.st_geomfromwkb(sde.st_asbinary(sde.st_startpoint(sde.st_geometryn(shape,1))), ...
CommunityBot
- 1
1
vote
1
answer
982
views
Does power of GPU affect performance of analyses by ArcGIS Desktop? [closed]
Does the power of GPU affect the performance of analyses such as Segment Mean Shift, conversion to/from raster, etc?
Is the GPU used only for caching GUI elements to give a smoother user interface ...
- 65k
2
votes
1
answer
407
views
OpenLayers deploy: what libs does selectFeature rely on?
I am trying to minimize my code by modifying OpenLayers deploy configuration file in order to reduce its load time. However, It seems that I can't include all necessary libs that OpenLayers....
- 65k
6
votes
1
answer
3k
views
What can be a reason of QGIS slow work?
Since I installed the new OSGeo4W installers for the 3.16 version around 2 weeks ago, my QGIS is sooo slow! No matter which installer I used (I tried the old and the new OSGeo4W network installer and ...
- 1
0
votes
1
answer
812
views
How to run an Overpass-API `around` query incrementally excluding already searched area?
I have to find some types of POIs around a given coordinates. Ideally, I want to find the nearest one of such POI around the given coordinates.
To meet my requirement I can search with either around
[...
CommunityBot
- 1
1
vote
2
answers
245
views
PostGIS - Fast area computation on large overlapping (or not) polygon dataset
I'm co-developing an PostGIS based API that will work with complex and potentially large sets (>10k) of polygons, extracted from a large table following custom, user defined filters. I have ...
CommunityBot
- 1
0
votes
0
answers
58
views
Huge layer takes too long to load and it's hindering my workflow
I have a huge point shapefile of InSAR data, on the heighs of 300k+ points in a single shapefile, over a large area. My workflow consists in manually checking and ensuring the quality of some points; ...
- 65k
1
vote
0
answers
37
views
Difference in performance executing process on layer from project or file
Is there any difference between loading layer into processing algorithm from file or from current project? I have a custom processing algorithm which crashes QGIS (depending on the machine - ...
- 1,267
5
votes
1
answer
120
views
Efficient way to compare fields or expressions of intersecting features: bulk-loading vs. get features one-by-one
I want to find an efficient (especially in terms of memoryusage and processing speed) method to compare intersecting features by attribute/expression.
For this script I am iterating over a ...
- 3,342
1
vote
0
answers
114
views
Is there a faster approach to change a data type on a feature class field in ArcGIS Pro 2.9.5?
I've followed the "Calculate Field Tool" steps from this article https://support.esri.com/en/technical-article/000023089 to change the data type on a field but it takes so long to copy the ...
1
vote
1
answer
182
views
Better workflow for extracting boundary of raster in QGIS
I have got a raster (.tif) which has areas with "no data". I want to extract just the area where i have data.
I can do this with gdal:polygonize (1) and native:dissolve (2).
But especially ...
- 31.4k
1
vote
0
answers
106
views
Speed up intersection on large polygons with PyQGIS?
Is there a way to speed up my script? I am new to PyQGIS. I am using QGIS 3.16.
What I need: I have 50 polygons (up to 1.675.000 hectares, mean 420.000 ha; one shapefile per polygon) and for each of ...
- 65k
0
votes
1
answer
131
views
Updating 3 million rows in file geodatabase
I have a GDB which has 3 million annotation data, then I would like to modify some filed values based on csv table
I'm using the following ArcPy scripts now, but it's too slow
import arcpy
import ...
- 105
3
votes
1
answer
245
views
PostgreSQL not taking full advantage of all computing resources
Basically I have one table buildings_by_cell_300m, About 2490000 rows. I want to statistic all the geom information within 50 meters of each geom.
I am doing:
CREATE TABLE gbmi.bn_by_cell_300m AS (
...
- 29.4k
25
votes
3
answers
16k
views
Speeding up plotting of polygons in R
I want to plot the country borders of North America over a raster image depicting some variable and then overlay contours on top of the plot using R. I have been successful in doing this using base ...
- 65k
0
votes
1
answer
527
views
ArcGIS REST API test performance
I need to test the performance of the ArcGIS REST API (Version: 10.51) on the map services I have created. The tester within our team is using swagger but it is not implemented in the ArcGIS REST API. ...
12
votes
6
answers
4k
views
Slow loading of QGIS Project
I have a number of standard projects set up for QGIS users. Some of them take more than 5 minutes to load. Things recently got much worse suddenly - and I want to track down why.
Are there any methods ...
- 2,247
4
votes
0
answers
193
views
Reducing loading time of QGIS project
I have saved a couple of QGIS projects in a PostGIS DB, which is hosted in the cloud. The projects consist of different layers. When I open the QGIS projects, the loading time is very long. That is a ...
- 2,247
1
vote
0
answers
160
views
ST_Intersection R(sf) Projected vs Geographic data. Significant performance difference [closed]
I'm working with OpenStreetMap (OSM) road networks for US States. I read all the roads for a state, then clip the roads to the state boundary layer using the boundary from tigris::states().
The OSM ...
- 65k