Questions tagged [performance]
Performance concerns how effectively a computing system uses resources.
163
questions with no upvoted or accepted answers
9
votes
0
answers
302
views
Performance-limits of QGIS expressions
I use quite often QGIS expressions and I am wondering how performant they are compared with other possibilities. In many cases, the same problem can be resolved using different approaches like using ...
- 67.2k
7
votes
1
answer
1k
views
Improving speed of GeoPandas dissolve
I am trying to dissolve grid spaces by category using GeoPandas' dissolve function, but it doesn't finish after hours of running and I want to make sure I'm not doing something wrong and/or there isn'...
- 905
6
votes
0
answers
323
views
Speeding up execution of PyQGIS algorithms
I don't understand why if I do "manually" some algorithms I get results much faster than when I insert the same in a PyQGIS code (with the same input).
This happens, for example, with the ...
- 123
6
votes
0
answers
536
views
When should I use gdal_merge.py?
When building a single georeferenced image from a collection of tiles, gdalbuildvrt followed by gdal_translate is much faster than gdal_merge.py.
In my own measurements of
gdal_merge.py \
--...
- 1,445
6
votes
0
answers
619
views
Slow performance of ST_CONTAINS on MySQL 5.7
I'm using MySQL 5.7 and I have two tables, one containing the geographies of every census block group in the US, for a total of 223,325 rows.
I have another table containing approximately 400 custom ...
- 263
5
votes
0
answers
446
views
In QGIS my expression aggregation in attribute forms slow works
There are two layers: Parcels and Parking.
Parking has attribute: parcels_objects, this is lists of parcels intersect of parking.
When I create a parking object, I want to calculate all parcels ...
- 143
5
votes
0
answers
336
views
Most performant KNN method in postgis (<->, <<->>, st_distance)
My question is about the fastest way to order query results by approximate distance. I've seen conflicting information about this.
My data are lat/lng points stored using WGS84 (SRID 4326).
The ...
- 151
5
votes
0
answers
598
views
Why my Geoserver on JBOSS/RHEL is slower than on Tomcat/Windows?
I have my Geoservers in 2 different environments: Tomcat on Windows and JBOSS on RHEL. I was guessing that JBOSS on RHEL will be faster, but to make sure I made some test plans with JMeter.
Both:
...
- 709
4
votes
0
answers
192
views
Reducing loading time of QGIS project
I have saved a couple of QGIS projects in a PostGIS DB, which is hosted in the cloud. The projects consist of different layers. When I open the QGIS projects, the loading time is very long. That is a ...
- 2,247
4
votes
0
answers
247
views
r.to.vect is not responding in QGIS GRASS
NLCD data entered for half of Illinois, all of Michigan and Wisconsin, plus additional along borders.
Used r.neighbors to simplify, then r.to.vect with "smooth corners" feature selected.
Got ...
- 41
4
votes
0
answers
5k
views
Point in Polygon using Rtree and Shapely
I am wondering what the correct syntax is for doing a point in polygon search using Shapely and RTree. I'm really interested in speeding the process up using the RTree index but am not having any luck ...
- 313
4
votes
0
answers
577
views
Performance issues Tilemill with PostgreSQL and large datasets
I have a Tilemill project the size of europe. I developed my style-sheet by using a smaller dataset (size auf Austria) and everything was perfect. But now I did apply the same styles to my big europe ...
- 991
3
votes
0
answers
83
views
Speed up a query using ST_Within and ST_PointOnSurface
CREATE TABLE municipal_area (
id varchar NOT NULL,
"name" varchar NOT NULL,
state_id varchar NOT NULL,
state_abbr varchar NOT NULL,
state_name varchar NOT NULL,
...
- 153
3
votes
0
answers
76
views
Why is it slow when deleting features in gpkg using PyQGIS?
Deleting features in a somewhat big GeoPackage takes a really long time and I am not sure if I do something wrong or if it is normal that it takes such a long time.
Data: line GeoPackage layer ...
- 3,342
3
votes
0
answers
202
views
Getting the results of a PostGIS query to a file with ogr2ogr with low memory usage
I have a PostGIS query returning geographies and attributes. The result set is deterministic and ordered (so OFFSET and LIMIT work for getting subsets).
The result set of my query would exceed my RAM ...
- 820
3
votes
0
answers
226
views
Method selectedFeatures() works too slow in QGIS 3 Python console
I loaded spatial table(about 100 millions rows) from PostgreSQL(PostGIS) in QGIS3 and use method selectedFeatures() in QGIS 3 Python console. For such big tables it work very slow (it takes up to 10 ...
3
votes
0
answers
49
views
Nesting styles for increased drawing speed
I have zoning plans for a municipalities ( for example 5700 features in this one) and I have created a QGIS-style to make it look like the offical style.
There are 72 colours/patterns for the ...
3
votes
0
answers
90
views
Scaling postgresSQL database when searching polygons against points?
I am using our single server -
CentOS 6.6 x64
16 CPU
24 GB
SSD
(PostgreSQL) 9.4.1
as our GIS database processing engine. This is part of the PostGIS software package installed on the server.
I am ...
- 31
3
votes
0
answers
713
views
QGIS clipper taking forever
As the project requires, I built virtual raster catalog merging two raster DEM files. Because I don't want to use the whole surface of the new Virtual Raster, I went on to clip a desired rectangle. ...
- 793
3
votes
0
answers
574
views
Geoserver MBTiles plugins performance issues
I am using the latest stable 2.7.2 version of GeoServer and I am trying to play with the MBTiles plugin, I have installed also WPS plugin that is needed by the MBTiles one (otherwise I got error when ...
3
votes
0
answers
157
views
ITopologicalOperator2 operation Simplify taking very long in ArcGIS 10.3.1
I have a method that does a simplification of geometries. I have used this common code since ArGIS 9.2 without issues and it still works fine in ArGIS 10.2.2. Recently I upgraded a project to 10.3.1 ...
- 31
3
votes
0
answers
739
views
Accelerating python looping process for A-star path finding on DEM surface?
I try to make an A-star Path Finding program base on tile-graph (image raster data as graph) where each pixel values represent as cost and elevation..
In my case, DEM raster data was called by using ...
- 702
3
votes
0
answers
787
views
Performance difference between focal statistics (ArcGIS) and neighbor (GRAS or QGIS)
I tested minimum, maximum, and average neighbor (circle radius = 161 pixel) using ArcGIS, GRASS and QGIS:
ArcGIS (10.1): it takes only one minute
GRASS (6.4.3): it takes 123 minutes for every output
...
- 799
3
votes
0
answers
331
views
Rendering performance
I am using ArcGis Java SDK for creating a map in my JavaFX application. I have a requirement to plot up to 500,000 graphics on graphics layer. When I do 100,000 graphics its performance is really bad. ...
- 171
3
votes
0
answers
226
views
Running SAGA Processing algorithm from console takes much much longer than from GUI?
I have a road layer with 32000 features, and I want to find all the intersections. when I use processing->SAGA -> convert polygon/line vertices to points, it is all done in less than 5 seconds. ...
- 929
3
votes
0
answers
801
views
How to understand output of ArcGIS System Monitor?
We had some performance issues with our enterprise ArcGIS server application, in this regard I have installed ArcGIS System Monitor v1.0.9. After installing and configuring the site, they are several ...
- 339
3
votes
0
answers
784
views
ArcGIS 10.1 & SQL Server 2012
We currently updated to SQL Server 2012 and now we are encountering a slower performance when connecting to the geodatabase on SQL Server 2012.
Here are the things that we tried to fix the issue:
- ...
- 415
3
votes
0
answers
124
views
Is there a way to constrain an FME.exe to certain amount of RAM?
If I have FME Desktop running on a workstation with a large amount of RAM (e.g. 128 GB), is there a way to constrain an FME.exe process to a certain amount of RAM (e.g. 48GB)?
This question is ...
- 14.6k
2
votes
0
answers
162
views
Improving performance of spatial intersection and aggregation query
Edit:
Per a comment, here is some more context and the basics of what I'm looking to do, that I think would better enable someone to offer input from a first principles perspective. Its a lot of ...
- 292
2
votes
0
answers
189
views
Leaflet Directive performance issues with 7539 GEOjson features
I'm using this example for my map but it seems that the map performance is pretty bad when zoomed. Currently the map have 7539 geojson objects (features) and in the future they will be around 9500. I ...
- 31
2
votes
0
answers
283
views
What is slowing QGIS the most when opening form?
I made a complete form on QGIS, following the best way, according to me, to make it fast and easy to use.
But, as I progressed in developing my form, QGIS went slower and slower to open it (almost 4 ...
- 489
2
votes
0
answers
435
views
Layer writing / exporting time in QGIS takes far too long
I am finding that QGIS takes quite some time when writing or exporting large datasets (approx 5 million records). A task I'm currently doing requires me to export 5 million points to a CSV, and this ...
- 209
2
votes
0
answers
91
views
Speeding up execution of Python code in QGIS's Python console
I have learned so much from this community. About two weeks ago I had separate code for each file that I was working with, now I am executing the following code:
from pathlib import Path
import shutil
...
- 179
2
votes
0
answers
177
views
Using QGIS field calculator expression on Execute SQL
The following expression copy only minimum value from group/subset to a new column field in QGIS.
Case when "FID_Net"=minimum("class", "FID_Net") Then "FID_Net" Else 0 End
But this expression on ...
2
votes
0
answers
387
views
Making Dijkstra faster
I would like to compute shortest path between 2,5 millions pairs.
I created table with id, origin, the nearest node of origin, destination, the nearest node of destination.
I also created index on ...
- 205
2
votes
0
answers
85
views
Speed up ArcPy CopyRows_management process on large feature layer?
I am attempting to automate an ArcMap process with Python and I am having difficulty with a particular part of a process taking too long when performed on larger datasets.
The process is as follows: ...
- 21
2
votes
0
answers
829
views
Arcpy 'Append_management' much slower than ArcMap Tool?
Basically I have a script that grabs data from a web service, parses it, stores it in an intermediary local fgdb, then appends that data to the feature class in the enterprise gdb.
The portion of the ...
- 29
2
votes
0
answers
1k
views
Optimizing MySQL query to select all points with in a large polygon using spatial indexes
Re-posting it from stackoverflow as per their suggestion. Link to the thread in stackoverflow https://stackoverflow.com/questions/53182385/optimizing-mysql-query-to-select-all-points-with-in-polygon-...
- 21
2
votes
0
answers
706
views
Does Geopackage field length affect performance?
I have moved away from shapefiles, and now store most of my desktop spatial data in a Geopackage. One of my fields is used to store research notes and is 'Type TEXT' with a character limit of 254.
I ...
- 3,200
2
votes
0
answers
221
views
pgrouting extension slow in PostgreSQL 10?
I am trying to implement routing on my road dataset using pgrouting function pgr_createTopology. It works fine on postgresql 9.6 but gets extremely slow and get stuck as nodes increase in postgresql ...
- 188
2
votes
0
answers
310
views
Caching WFS requests using OpenLayers?
I'm investigating how we can improve our vector-layer performance of our GIS component (based on openlayers 4).
OpenLayers keeps all the fetched vector features in memory. This becomes a problem ...
2
votes
0
answers
92
views
Unable to get points in buffer on selected feature in QGIS using Python?
I have to create a 1.5 km buffer on each latitude/longitude of layer A. I would like to know how many points of line B will be inside the buffer of layer A. I used the following code but it takes too ...
- 349
2
votes
0
answers
2k
views
Speeding up Raster to Polygon Conversion in ArcMap/arcpy
I am trying to convert a series of big binary rasters describing data in grey (value 0) and nodata in green (value 1) into polygons in order to derive the extent the data pixels are covering (see also ...
- 427
2
votes
0
answers
469
views
QGIS virtual layer with SQL GROUP_CONCAT performance
I have a polygon shapefile layer, Property, with property ownership parcels and a SQLite database with projects. My goal is to highlight the parcels where an entry in the Projects database and show a ...
- 151
2
votes
0
answers
188
views
Faster equivalent of arcpy distanceTo method
Unfortunately arcpy distanceTo method is painfully slow. When speed is crucial, I am still using Avenue to work around it, but it is getting harder to transfer ArcView 3 to newer computers.
As ...
- 22.6k
2
votes
0
answers
154
views
Improve performance of a stand-alone table join in a Feature Service
I have an mxd with data-driven pages using Feature Layers from ArcGIS for Server (Workgroup Standard) with MS SQL Server Express. The DDP index layer has a join to a stand-alone table. I am ...
- 89
2
votes
0
answers
134
views
Geodatabase configuration keywords
I am trying to insert a new polyline dataset within my Oracle server database. The dataset in question is located within a local GDB, and is currently c420mb in size. It is taking hours and hours to ...
- 2,281
2
votes
0
answers
84
views
postgis query performance
The db structure is more or less like this and can't be modified. I can only add some indexes but can't set for example foreign keys:
CREATE TABLE adresspoint
(
id character varying(3999) NOT ...
- 21
2
votes
0
answers
860
views
Is there a comfortable way to generate efficient raster catalogs in QGIS?
Is there a comfortable way to generate efficient raster catalogs (such as in Arcgis), where polygon tiles are loaded as long as the scale does not hit a threshold value and images are only loaded when ...
- 511
2
votes
0
answers
157
views
Large amount of time publishing to ArcGIS Online?
Publishing <5Mb tile packages to ArcGIS Online is taking more than 20 minutes. ESRI tech support has consistently given extremely vague answers that never solve and always reference server load. &...
- 59