A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

Questions tagged [performance]

Performance concerns how effectively a computing system uses resources.

Filter by
Sorted by
Tagged with
0
votes
1answer
47 views

How to profile rendering performance using QGIS 3.10.x or above?

I am looking to be able to profile the rendering performance of a map and/or its individual component layers using QGIS. The metrics I am most interested in are: Access time Storage IOPS Storage time ...
2
votes
1answer
103 views

Accelerating GeoPandas for selecting points inside polygon

I have one dataset with about 10 million points (lat, long). I would like to select the points that fall within a map. I have this map as a shapely object (.shp). To do this, I transformed the ...
0
votes
0answers
26 views

Getting SQL explain-plan for ArcGIS Map service

My organization has an ArcGIS map service that contains registered views from an Oracle 18c/10.7.1 geodatabse. I'm having some performance issues with the layers/views in the map service. I want to ...
1
vote
0answers
3k views

Reading shapefile faster using Python basemap (and pickle)

I am trying to plot a simple 'merc' map with boundary from shapefile. The total size of the shapefile ne_10m_admin_0_countries_lakes.shp is just 8mb. The simple mslp surface plot from GFS data took ...
1
vote
0answers
45 views

Using QGIS field calculator expression on Execute SQL

The following expression copy only minimum value from group/subset to a new column field in QGIS. Case when "FID_Net"=minimum("class", "FID_Net") Then "FID_Net" Else 0 End But this expression on ...
1
vote
2answers
82 views

Layer from PostGIS view with dissolve slower than without in GeoServer

I created a view of a table containing line segments, where many lines may be part of the same project (and not necessarily adjacent) in PostgresSQL/PostGIS. The segments are joined to another table ...
0
votes
1answer
20 views

GZIP geojson files & Mapbox GL JS

Is there a way to serve mapbox GL gzipped geojson files? I have style.json file that pulls multiple geojson files and it is pretty heavy.
4
votes
1answer
82 views

Optimizing Intersection Area Loops on big layers using PyQGIS

Using 3.10.1-A Coruña on Windows 10 I am looping over some (10) national shapefiles and finding intersection and areas but the process is very slow. I have two loops - one loop for each postcode and ...
2
votes
1answer
554 views

MSSQL Spatial Query (View) is Slow in ArcMap

I created the following view in Microsoft SQL Server 2008 R2: CREATE VIEW test AS SELECT p.id, p.shape FROM p INNER JOIN r ON p.shape.STIntersects(r.shape) = 1 WHERE r.Name = '...
0
votes
0answers
28 views

Automating Buffer Wizard in ArcGIS Desktop by working in Shell [duplicate]

I am using ArcGIS Desktop 10.x. I am trying to automate the Buffer Wizard since I have several large sets of the data that I need to buffer at multiple distances. Doing it by hand will take a long ...
1
vote
1answer
25 views

Improving performance of shapely crosses

I am unsure if this is the fastest way to test if LineStrings cross each other. Is there a better method. for line_1, line_2, in itertools.combinations(lines, 2): crosses = line_1.crosses(line_2) ...
1
vote
1answer
66 views

Expedite Near function in ArcMap 10.7 for 10^9+ coordinates?

I want to find the geodesic distance between the closest hydrography feature to each of my lat/long coordinates. I have hydrography data from New York state in a shapefile. I have many points, 10^10 ...
5
votes
1answer
2k views

Speeding up band math in R 'raster' package

I have some GeoTiff rasters with over 100 bands in total, but they are not huge: resolution is about 1200x600 and total size is less than 7 mb. I'm trying to do a simple NDVI calculation: raster <-...
7
votes
2answers
6k views

Maximizing Code Performance for Shapely

I've written this code in order to calculate the percent cover of grassland within a national park, within 20km^2 of points of recorded occurrences for a species. It is designed to only consider the ...
3
votes
0answers
111 views

Arcpy 'Append_management' much slower than ArcMap Tool?

Basically I have a script that grabs data from a web service, parses it, stores it in an intermediary local fgdb, then appends that data to the feature class in the enterprise gdb. The portion of the ...
0
votes
1answer
3k views

How to speed up Google Geocoding API Slow performance?

I am using Google geocoding API service with their Java client, and my dev Key, The problem is when I run up to 40 requests it does slow to 600ms. I am using it in a webservice that is supposed to ...
0
votes
1answer
291 views

Improving performance of Update Column in MapInfo?

I have two files in MapInfo Professional: A mapped 'Network' file A non-mapped 'data' file. They have similar data in terms of their 'link ID' I have created a number of columns in the 'network' ...
5
votes
1answer
153 views

Speeding up searches on layer with many attributes?

I'm using QGIS 3 with my data in a PostGIS server on the same local network. I want to quickly search for a feature based on a certain attribute or attributes of my layer. This layer has ±2 million ...
1
vote
1answer
35 views

Downloading or caching web based map service for faster access?

The Western Australia Department of Mine and Petroleum allows access to one of their online systems called Tengraph Web with which I can view tenements, major infrastructure, and topography for the ...
1
vote
1answer
82 views

Distance between coordinates computation speed: conversion to UTM vs Great Circle

For a program I am writing I need to calculate the distances between coordinates. Seeing as I need to perform a large number of these calculations for each coordinate (thousands) it makes sense to ...
4
votes
1answer
140 views

QGIS incredibly slow when trying to update large tables?

My point postgresql table has about 500k rows and about 20 columns People have about 5 fields that they update, the other fields are static Selecting the points is fairly instant, however using the ...
4
votes
2answers
2k views

Determining percentage of intersection between two shapes In Oracle Spatial

I have to query polygons that intersect with one another. Our polygons occasionally contain intersections that aren't intended (meaning just a few vertices cross boundaries). I want to filter out ...
1
vote
0answers
74 views

Method selectedFeatures() works too slow in QGIS 3 Python console

I loaded spatial table(about 100 millions rows) from PostgreSQL(PostGIS) in QGIS3 and use method selectedFeatures() in QGIS 3 Python console. For such big tables it work very slow (it takes up to 10 ...
0
votes
1answer
697 views

Severe performance difference using deleteSearchedRows [closed]

The issue I am having involves two versioned tables. A function deletes 48 rows from Table A and and 48 rows from Table B using deleteSearchedRows. However, the delete from Table A takes roughly 4 ...
6
votes
1answer
351 views

Time to open 3.5GB File.GDB directory vector layer in QGIS

I am a new GIS user, and have started with QGIS 2.01 Dufour. I am trying to open an ESRI-style File.GDB (v10) directory that has a 3.5GB gdbtable file that is of Texas state hypsometry/topography. ...
1
vote
1answer
43 views

Speeding up PostgreSQL UPDATE query?

I have a query running as below: UPDATE datasets.riverside_houses SET easting = addressbase.x_coordinate FROM datasets.addressbase WHERE addressbase.building_number = riverside_houses.house_number OR ...
6
votes
1answer
137 views

ArcPy UpdateCursor auto pausing after every 1000 records

I have an update cursor running that updates a field based on a lookup table (Python dictionary). The cursor completes fine, but seems to pause and hold after each 1000 records - I have a test in it ...
0
votes
0answers
21 views

Bulk modifying field alias names in file geodatabase [duplicate]

I am currently running large batches of modifying field alias names in a single file geodatabase. I am using ArcPy (ArcMap 10.7) AlterField_management function but it is too slow as it runs one at a ...
4
votes
2answers
121 views

Running arcpy.AlterField_management 2,000 times takes too long?

I am trying to replace field names of a table stored in a file geodatabase using a dictionary as a lookup table. My field names got cut off from the Tabulate Area tool (Tabulate Area Truncates Field ...
0
votes
0answers
87 views

OpenLayers performance issues adding features to vector layers

I have a fairly standard looking setup (standard in my eyes) but my performance is dreadful. My issue is that any fix stands me up for a fairly large reactor so I was hoping to get some advice. I ...
2
votes
2answers
2k views

Tuning Esri Geodatabase on Oracle Spatial (SDO_Geometry) performance? [closed]

We are storing data in a Geodatabase on Oracle 11g using Oracle Spatial with SDO_Geometry, and then consuming that using ArcGIS server 10.2.1. The performance is very slow, because we are talking ...
0
votes
0answers
53 views

Simplifying Mapbox vector tiles from GeoServer for beter performnce?

I use MapBox Vector tiles from GeoServer on my open source web site. How can I improve the performance of this service and how can I simplify the geometry of this service for performance? I know that ...
1
vote
1answer
1k views

Improving performance of Ext Grid with GeoExt WMSCapabilitiesStore?

i have a question concerning the performance of the Ext Grid when loading big datasets from the GeoExt WMSCapabilitiesStore. My application loads about 2500 layer records in an Ext Grid Panel. Once ...
1
vote
0answers
91 views

QGIS 3 running slowly

I've been using QGIS 2.14 pretty successfully for about two years. I do also have Arc but tend to use Q more primarily because it did run considerably faster. I then installed QGIS 3 as I noticed it ...
1
vote
1answer
1k views

Which is the faster way to copy data to another feature class: Feature Class to Feature Class or Insert Cursor

I have a feature class with 1 million records. Which is the faster way to copy data to another feature class: Feature Class to Feature Class or Insert Cursor?
1
vote
1answer
46 views

Speeding up script to flag nodes within 100 feet of segments using PostGIS?

I'm working with two datasets, attempting to flag when an intersection is within 100 feet of a network subset. There are over 40,000 intersections and my network is ~ 1400 segments. The problem with ...
2
votes
0answers
38 views

Speed up ArcPy CopyRows_management process on large feature layer?

I am attempting to automate an ArcMap process with Python and I am having difficulty with a particular part of a process taking too long when performed on larger datasets. The process is as follows: ...
1
vote
2answers
352 views

MySQL 8 MBRIntersects 10 times slower than PostGIS equivalent

I'm trying to migrate a PostGIS database to MySQL 8 and am having a big performance hit when it comes to MBRIntersects. Using Mapbox to render vector tiles, I need to extract geometry intersecting ...
-1
votes
1answer
66 views

Making looping through line segments for vertex points faster?

I am trying to speed up some current code that I have for looping through lines, getting their segments and ultimately the vertex points in Python. Can anyone recommend a faster method than what I ...
1
vote
1answer
135 views

Improving select and edit features performance of QGIS plugin?

I wrote a plugin for selecting and instant updating the value of the selected feature in the attribute table. I tested with a big shapefile and to select and edit 5 features takes ~5 seconds. Which ...
3
votes
0answers
154 views

Running SAGA Processing algorithm from console takes much much longer than from GUI?

I have a road layer with 32000 features, and I want to find all the intersections. when I use processing->SAGA -> convert polygon/line vertices to points, it is all done in less than 5 seconds. ...
2
votes
1answer
85 views

Populating layer field with dict.values() in PyQGIS 3?

I've coded the script below in PyQGIS 3 to get the azimuth of starting or ending points for a line layer that touches a border. It works fine, but I want to populate the azimuth field layer with the ...
1
vote
0answers
81 views

Calculating nearest distance between points and Spatial Polygons in R? [closed]

So right now I have pretty large datasets, about 200,000 (lat,long) locations and a Large SpatialPolygonsDataFrame with a polygons list of length 428386 spread in a single city of around 450 square ...
2
votes
3answers
470 views

Optimizing arcpy.da.Walk performance?

I'm trying to automate a workflow that currently costs a co-worker about 45 minutes. General run down is this person copies files from a network drive onto a local one, and process it through four ...
12
votes
3answers
14k views

Measuring performance difference between Merge and Append in ArcGIS Desktop?

Often I find myself in a situation where I don't care whether or not my tool produces a new feature class, but I do care how long it takes to combine all of my large datasets. Does it take longer to ...
0
votes
0answers
104 views

Improving speed of GeoPandas dissolve?

I am trying to dissolve grid spaces by category using GeoPandas' dissolve function, but it doesn't finish after hours of running and I want to make sure I'm not doing something wrong and/or there isn'...
6
votes
4answers
16k views

Avoiding GeoServer/Java out of heap space error?

I'm new to Geoserver, Ubuntu and Java, but have downloaded a virtual machine from gisvm.com and am getting up to speed. I got as far as configuring it with some fairly large shapefiles from a project ...
3
votes
0answers
119 views

Slow loading of QGIS project?

I have a number of standard projects set up for QGIS users. Some of them take more than 5 minutes to load. Things recently got much worse suddenly - and I want to track down why. Are there any ...
7
votes
4answers
5k views

QGIS rendering performance bottleneck?

When I load a vector with a large number of features into QGIS, the rendering time can become extremely slow. But when I look at my system resources, they all have plenty of excess capacity. What is ...
2
votes
1answer
30 views

Updating field in geodatabase table depending on other field using ArcPy?

I have a table in a file geodatabase that has "FieldA" and "FieldB". I want to update FieldB with one of two values, depending on if there are one or more records with the same value of FieldA. ...