Questions tagged [performance]

Performance concerns how effectively a computing system uses resources.

Filter by
Sorted by
Tagged with
3
votes
0answers
377 views

Optimizing PostGIS/Geoserver schema for huge dataset [closed]

I'm trying to efficiently serve forecast streamflow WMS images from a PostGIS database using Geoserver 2.9x. My dataset (currently > 5TB) consists of static polylines (2.3 million of them) that each ...
1
vote
1answer
298 views

Understanding KML To Layer performance in ArcGIS Desktop? [closed]

I've got a very simple code using an ArcPy tool to convert KMLs to Layers in a directory: import arcpy, os from arcpy import env arcpy.env.workspace = r"C:\KML\Test" outLocation = r"C:\KML\Test\...
2
votes
0answers
100 views

Raster functions performing poorly in ArcGIS Desktop? [closed]

After installing 10.5 I noticed some documents were taking much longer to open, some 4 to 15 minutes and others would not open at all. Initially I thought some databases/rasters were corrupted but it ...
2
votes
1answer
425 views

Strange slow behavior of a very simple query utilizing single PointField field

Infrastructure on AWS RDS: PostgreSQL= 9.6.1 POSTGIS="2.3.0 r15146" GEOS="3.5.0-CAPI-1.9.0 r4084" PROJ="Rel. 4.9.2, 08 September 2015" GDAL="GDAL 2.1.1, released 2 016/07/07" LIBXML="2.9.1" LIBJSON="...
1
vote
0answers
332 views

Drawing extremely slow and cancels

I'm working on a series of maps and whenever I select a symbol, or pan, or anything my whole map has to redraw. It is a very slow redraw. I generally have to wait 5-10 seconds, even if I am just ...
5
votes
1answer
8k views

High performance markers on Leaflet map [closed]

I'm using Leaflet to visualize a large number of points on a map. The points don't need to be very fancy, I just need to be able to set a radius (doesn't matter if it's pixels or meters, I just need ...
2
votes
1answer
50 views

Point layer draws very slowly after using ArcPy to add to mxd?

I am using an ArcPy script to add a point feature class to an mxd. The map document will draw this layer very slowly, approximately 50 to 100 points per second. If I remove the layer and add it ...
1
vote
1answer
215 views

Measure Performance per layer in QGIS

I'm working in a relatively large project in QGIS 2.14, mostly loaded with .shp files. The issue is that lately got painfully slow when zooming or changing map view. I've tried to delete the largest ...
2
votes
2answers
111 views

Reduce Processing Time for Update Cursor

I am updating a field for a feature class that is on an enterprise geodatabase in SQL server. This is an ArcSDE connection. My goal is to search for null values, and convert these to 0. The script ...
2
votes
2answers
729 views

Speeding up QGIS spatial join?

I am trying to calculate the coverage that a set of points has of a road network layer. I have 100 million points and approximately 80,000 segments in my road network layer. I have created a buffer ...
1
vote
1answer
233 views

How to create a small polygon vector layer from a larger layer efficiently in QGIS?

I am creating a plugin for QGIS in python which needs to load in parts of a larger polygon vector layer. This layer is taken from a shapefile and then a new smaller vector layer is created by adding ...
1
vote
1answer
91 views

Error when exporting “MXDPERFSTAT” tool

I am running this tool: https://www.arcgis.com/home/item.html?id=a269d03aa1c840638680e2902dadecac Mxdperfstat- basically it records the loading time for drawing the layers so you can optimize data and ...
1
vote
1answer
3k views

Improving display efficiency of OpenLayers 3 Cluster?

In OpenLayers3, when the number of points more than 1,000,000, the display efficiency is too low. How to solve this problem? The following code is the example in OpenLayer3, and I had changed the ...
1
vote
1answer
50 views

ArcMap Renderer Memory Usage

I have two MXD files, both of them have one feature layer with unique value renderer and multiple values. Symbols are completely different but all of them are approximately 500 x 500 and 72 DPI. when ...
1
vote
1answer
462 views

ST_DWithin Optimization Postgis

I've got two datasets - 1) a set of buildings in LA and 2) fiber optic cable maps from a company called Zayo which covers the whole of the US. I'd like to find the buildings within a certain distance ...
2
votes
2answers
355 views

About speed, commitChanges too slow. How avoid this?

I am working on a standalone script, executed out of QGIS console, and I have noticed that the script takes a lot of time when it executes the line: layerB.commitChanges () How my script works ? I ...
5
votes
3answers
481 views

Improve the speed at which arcpy creates a layer object

Is there something happening on the back-end, that makes the process below so slow, that can be avoided to speed it up? It is taking between 5 and 7 seconds to turn one layer file (.lyr) into a layer ...
13
votes
5answers
1k views

Looping through 16 million records using ArcPy?

I have a table with 8 columns and ~16.7 million records. I need to run a set of if-else equations on the columns. I've written a script using UpdateCursor module, but after a few million records it ...
1
vote
0answers
145 views

Slow Elevation Batch Queries in PostGIS?

I've been exploring PostGIS and have found it to be quite slow and I thought I would ask the community if they notice any blatant flaws in my queries. First, let me say that I need to query elevation ...
7
votes
1answer
1k views

How to improve performance of nested search cursors?

I have three nested SearchCursors. It works correctly but with slow performance. There are some solutions to improve the searchcursor performance like dictionary but i don't know how to use it with ...
2
votes
2answers
213 views

Improve speed of PostGIS query for counting locations

I have one table that imported from shp file (projection - wgs84- polygon). The table (locations_list)has 5 fields: id, geom, pin, shape_star, shape_stle, isEmpty. I created spatial index on the ...
1
vote
0answers
257 views

How to Bulk Import to R-tree using a Generator?

I've been trying to improve one of a couple of scripts I'm writing to be comparable to the other script in performance speed which uses a different approach to tackle the same FGDB problem. I'm ...
2
votes
1answer
113 views

Should I create multiple tables or one table for all PostGIS data?

My goal is to create an application in which I have 2 "types" of data that I will be querying against. I will have points and polygons. Ultimately I will be querying to find all of the polygons that a ...
4
votes
4answers
540 views

Querying Thousands of Points with ST_Value()?

Currently I have an application using the psychopg2 Python library to query a database for elevation data. My current python implementation looks like the following: def GetElevation(lat, lon, ...
1
vote
0answers
453 views

Shapely Implementation Dramatically Slower than PostGIS

I'm trying to characterize two different python scripts and how fast they rip through the same file GDB on a thin client remotely accessing a Linux server where the FGDB and scripts are stored. The ...
4
votes
4answers
567 views

Not loading all features in attribute table viewer/editor when QGIS opens?

Is there a way to have the QGIS attribute table viewer/editor not load the entire dataset when opening? I'm working with a shapefile of 100,000 grid references and this is rendering the application ...
2
votes
0answers
101 views

SQL Server data types supported in ArcGIS [closed]

I am wondering if there is a known difference in processing speed in ArcGIS between the three geometry data types in SQL Server: compressed binary, SQL Server geometry, and SQL Server geography. We ...
1
vote
1answer
113 views

Speed of Layer Rendering and Visibility in ArcGIS Online

This map is a combination of several layers: http://arcg.is/2fTGANA When I share this out with others they experience difficulty in rendering when they log in to AGOL as compared to when they do not. ...
3
votes
0answers
439 views

Slow performance of ST_CONTAINS on MySQL 5.7

I'm using MySQL 5.7 and I have two tables, one containing the geographies of every census block group in the US, for a total of 223,325 rows. I have another table containing approximately 400 custom ...
0
votes
1answer
54 views

Measuring QGIS performance to render 1-bit tif raster grids? [closed]

I notice that since weekly 2.17, it renders my 1-bit tif raster grids slower than 2.16, when I move viewport. The new release 2.18 does the same as 2.17. So I move back to 2.16.3. Are there changes ...
2
votes
1answer
284 views

Fastest matching on nearest point

I am a total GIS noob and am trying to read weather data from a PostGIS database. The tables contain data points consisting of a geometry, a timestamp and the actual observed variable. The tables are ...
1
vote
1answer
108 views

Displaying 1000 hiking trails with GeoServer [closed]

I am writing a web application to visualize a database of ~1000 hiking trails. All trails should be displayed simultaneously. Each trail should be individually clickable to view hiking information. I ...
1
vote
1answer
262 views

Speeding up Arcpy script with lots of for loops and cursors?

I'm running this chunk of code (below) inside a larger script. This section is supposed to find the time for each boat (mmsi) that is closest before and closest after a single detection time. It first ...
0
votes
3answers
2k views

Displaying hundreds of thousands points on web map?

I'm dealing with around 150,000 points on a map. My customers need to see all the points, wthout clustering. I tried Openlayers and Mapbox GL Js, both have the same issue: its memory costs are huge! ...
1
vote
1answer
274 views

Deleting many duplicate points using ArcGIS Desktop?

I have a shapefile with more than 6 million points, most of which are identical. I used the built-in tool Delete Identical by using Shape property to do it, which takes almost 10 hours and only ...
1
vote
1answer
340 views

Joining 17 million points to one dissolved polygon layer taking over 24 hours to run!

I am trying to count how many points, out of 17 million, fall inside a polygon (see image below) which I created from dissolving various buffers and features. The polygon layer is thus one dissolved ...
2
votes
1answer
540 views

Why output file of “mosaic to new raster” in ArcGIS is unreasonably large

I am trying to mosaic seven dem files together by using "mosaic to new raster". The largest one is about 100 GB, and the other six files are total 50 GB. I used "FIRST" mosaic method and the cell size ...
1
vote
0answers
135 views

Finding points around closest point of linestring ordered by distance using PostGIS?

I am looking for a way to improve my solution of the following problem in PostgreSQL (using PostGIS). Given a point A, a Linestring B and a series of (yellow) points spread all over the area in which ...
2
votes
1answer
355 views

Looping Through Multiple Shapefiles - GDAL/OGR - Possible Performance Issues

I am trying to filter data from shapefile1 based on specific attributes in shapefile2. Specifically, I would like to determine if numbered ranges within shapefile1 have been reversed in shapefile2, ...
0
votes
1answer
238 views

Finding if point exists in shapefile using shapely performance?

I have a data frame that consists of 2 million rows (lat, lon) and I am trying to figure out if each of these points are in a boundary defined by a shapefile or not (intact I am looking at multiple ...
7
votes
4answers
5k views

QGIS rendering performance bottleneck?

When I load a vector with a large number of features into QGIS, the rendering time can become extremely slow. But when I look at my system resources, they all have plenty of excess capacity. What is ...
2
votes
0answers
585 views

Dissolve taking a really long time ArcGIS 10 [closed]

I'm having an issue running several dissolves in both Arcgis 10.1 and Python 2.7.2, and 10.2.2 and Python 2.7.5 using arcpy.Dissolve_management (I'm working on 2 virtual machines). In both cases the ...
0
votes
1answer
214 views

How to get geojson WFS to run faster

I use geoserver + openlayers. The problem is that WFS geojson layer has over 10000 objects and when i'm trying to see the map through web-browser it works very slow and laggy. How can i speed it up?
2
votes
1answer
307 views

Performance tuning Python code to query and update data in PostGIS stored on local machine?

I developed this code to query and update data in a postgres/postgis database that is stored on a local machine. The table being analyzed has only around 150K records. The code takes 6-7 hours to run, ...
2
votes
0answers
91 views

Improve performance of a stand-alone table join in a Feature Service

I have an mxd with data-driven pages using Feature Layers from ArcGIS for Server (Workgroup Standard) with MS SQL Server Express. The DDP index layer has a join to a stand-alone table. I am ...
1
vote
1answer
265 views

Speeding up connection to MS SQL Server in QGIS?

Currently when I try to connect to a SQL database in QGIS it takes a bout 30 seconds for all features in the database to load. I have over 100 tables with geometry columns. When I try to connect to ...
1
vote
0answers
53 views

Geodatabase configuration keywords

I am trying to insert a new polyline dataset within my Oracle server database. The dataset in question is located within a local GDB, and is currently c420mb in size. It is taking hours and hours to ...
1
vote
2answers
224 views

Speeding up join in ArcPy?

I am joining some tables to a shapefile and exporting with the following code: import arcpy, pandas as pd, os import arcpy.mapping arcpy.env.overwriteOutput = 1 arcpy.env.qualifiedFieldNames = False ...
2
votes
1answer
614 views

Using FeatureLayer or ArcGISDynamicMapServiceLayer

I am in the process of updating a web map that was using the ArcGISDynamicMapServiceLayer object for my layers. At the time, it was the best choice since we were on 9.3 and there was limited support ...
2
votes
1answer
72 views

QGIS Spatialite select by expression performance

I've created a spatialite database with 1,600,000 rows with an index on one of the fields, when I query the indexed text field using the spatialite GUI the response is almost instant. If I load the ...