Questions tagged [memory]

memory is the process in which information is encoded, stored, and retrieved.

Filter by
Sorted by
Tagged with
2
votes
2answers
44 views

Error generating chart: User memory limit exceeded, when changing dataset from T1_TOA to T1_SR

So, I got the code to work for T1_TOA band, but then when I switched it over to T1_SR band it gave me this error: User memory limit exceeded. So, I poked around the forum and found the code to limit ...
2
votes
1answer
41 views

Memory issues projecting a large raster mosaic of USGS DEMs in R

I am trying to project a large raster to UTM (meters), but I keep crashing my laptop (16GB) due to a memory shortage. It seems like using projectRaster tends to deplete the machine's memory, and some ...
1
vote
1answer
33 views

QGIS Hot Spot analysis plugin Python memory error

I try to create an Hotspot crime map of Greater London. I created grid, counted points layers. When I try to use Hotspot analysis plugin after a while my memory spikes like crazy (16gigs) and this ...
1
vote
0answers
25 views

QGIS / “create grid” consumes far more memory on linux than on windows

I am using QGIS 3.10 both on windows and on Linux with the same RAM and CPU resources. When running the tool "create grid" QGIS behaves strange on Linux: For a certain extent (~ 10x10km), ...
0
votes
0answers
31 views

Why do I have such a high memory usage for this rioxarray code?

For my code using rioxarray I am opening quite an amount of raster files. One after another. I even added del to remove those from memory, even though I thought I would not be nessary, because they ...
0
votes
0answers
28 views

Python GDAL VRT reading using 50% of available memory. How to limit this?

When reading in areas of a VRT with vrt.ReadAsArray(...) I see RAM usage will keep increasing up to about 50%. This is fine but becomes a problem for when running on a computing cluster with huge ...
2
votes
0answers
48 views

Releasing ArcMap memory by removing *.sr.lock files from shapefiles

Is there a method of removing *.sr.lock files from shapefiles to release memory consumption without closing out of an ArcMap application? I am attempting to run code that will cycle through 200+ ...
1
vote
1answer
98 views

How to fix the problem of 'out of memory' in PostGIS Raster processes?

I am trying to combine a series of overlapping rasters to find out the most recent data. I think I may have 10,000 layers. When I run this query: CREATE TABLE most_recent AS ( SELECT ST_Union(rast,...
1
vote
1answer
723 views

Read and then write rasterio GeoTIFF file without loading all data into memory

I work with large drone image raster files, on the order of 40,000 x 40,000 and above. I have a large uncompressed GeoTIFF file and I want to use rasterio to rewrite the file in compressed format. I ...
3
votes
0answers
47 views

Getting the results of a PostGIS query to a file with ogr2ogr with low memory usage

I have a PostGIS query returning geographies and attributes. The result set is deterministic and ordered (so OFFSET and LIMIT work for getting subsets). The result set of my query would exceed my RAM ...
0
votes
0answers
50 views

Working around “Unable to allocate memory” error during for-loop in Arcpy

I'm running a very long for-loop in Arcpy (with ArcGIS 10.7 on Win10) over several ten thousand files. It runs smoothly until, everytime after about 3000 iterations (3-4h), it crashes with the error ...
0
votes
0answers
36 views

Memory limit and computation time out for NDVI Map in Google Earth Engine

I am trying to get an NDVI time series over a specific area of the Everglades and have the below script. When I try to run it I keep getting a memory exceeded error and also a computation time out ...
0
votes
0answers
19 views

storing raster column externally in PostgreSQL

I read this article by Paul Ramsey: 5x Faster Spatial Join with this One Weird Trick I was thinking whether we can do it for the raster columns or not. Because working with rasters is usually very ...
0
votes
1answer
105 views

ArcObjects C# memory management - Out of memory exception

I'm a noob in C# and ArcObjects (started two weeks ago). I'm trying to write a stand-alone console program that will change label placement quality in all data frames for all MXD files in a given ...
5
votes
2answers
71 views

Do Navigation Apps Shrink the Hippocampus?

A study shows London cab drivers' hippocampi grow compared to a control group of similar non-drivers. I presume these cab drivers don't rely on navigation apps. ...acquisition of an internal ...
1
vote
1answer
196 views

Running into memory issues when loading a composer layout

I'm trying to load a specific composer layout model, but it not respond properly, slowing down my computer, consuming all it's memory, to the the point of giving me no option but a Windows hard reset. ...
1
vote
0answers
62 views

pyqgis 2.18.16 - Segmentation fault error at 2nd run

When use pyqgis+python for auto-mapping, I encounter a tricky Segmentation fault (core dumped) error, at the 2nd run of the program. I checked previous similar post but not able to fix the issue. I ...
1
vote
0answers
23 views

Memory management in offline routing with n waypoints?

I am trying to build an offline routing system with a map database on a portable Android device. Since I am still doing some research, I am stuck on what I think is a fundamental problem. To find the ...
0
votes
0answers
31 views

ArcGIS Modelbuilder model clogs up memory?

I have a model in which a zonal histogram is computed of each line in a feature class, showing the amount of cells each line intersects in a raster file. After this, this column is joined to a table ...
0
votes
1answer
78 views

How to free the memory of return value of OGRGeometry::Buffer()?

I have in C++ (gdal 2.3.2) OGRPolygon poly; OGRGeometry* geom = poly.Buffer(1e-12, 1); now how do I free the memory allocated for geom after done using it?
0
votes
1answer
203 views

Using Hyperion with Google Earth Engine [closed]

I am trying to use Hyperion Data for my project, unfortunately even loading the Image Collection of Hyperion exceeds my maximum 2.5 GB Data Storage. Hyperion has a revisitrate of 200 Days, so a one ...
0
votes
1answer
57 views

Pros and cons of saving data on a memory stick [closed]

I have just about reached the capacity of my laptops internal Solid State Hard Drive (Sandisk SD8SNAT-256G-1006) and I looking for some additional storage without having to buy a new machine. You ...
0
votes
0answers
84 views

Exporting Layer to Feature Class is Incomplete without Error

I have a CSV of 1.2 million records that I want export to a GDB as a feature class. I've done this numerous times, but this was before upgrading from 10.5. Steps: Add CSV Display X/Y table Export to ...
2
votes
0answers
37 views

Using destructors in PyQGIS?

Related to my Problem described in PyQGIS memory issues, I'd like to try using destructors for QgsGeometry and other classes. I dont get how to use them though. According to https://qgis.org/api/2.18/...
3
votes
0answers
158 views

PyQGIS memory issues [closed]

I have some big problems with the memory usage of my standalone PyQgis script based on QGis 2.18 and run on ubuntu/linux (happens also on Windows 10 though). I will document it very precisely using ...
0
votes
1answer
252 views

Geoserver - how clear memory after tile-seeding and normal wmts queries

I am currently doing a lot of seeding of tiles in GeoServer and I noticed that after the tiling process is over the memory that is required during the task is not cleared. The same thing happens after ...
2
votes
1answer
55 views

Watershed issue

I am attempting to create a catchment of Danube. So far I have used the r.fill.dir to create a depressionless map and flow directions. Thus, I am now looking to use r.watershed to create stream ...
0
votes
1answer
171 views

Topology error in ArcGis

I am trying to intersect a large feature class (118692 elements) with a grid (58000 elements) but I get an error message. Traceback (most recent call last): File "Path/InterJoin.py", line 24, in &...
1
vote
1answer
944 views

How to increase Java heap size on GeoServer on Windows?

I tried setting wrapper.java.maxmemory=1300 parameter in c:\Program Files (x86)\GeoServer 2.11.1\wrapper\wrapper.conf but I can't set more than 1300MB (geoserver service can't start). I tried ...
1
vote
1answer
906 views

QGIS: How to create a permanent vector layer

I am currently creating an vector layer like following: outLayer = QgsVectorLayer('Linestring?crs='+ crs, 'graph_with_azimuth_ogr' , 'memory') The outLayer is now stored in memory, which means it ...
0
votes
0answers
175 views

Mapshaper running out of memory on R

I'm using rmapshaper, the R wrapper of MapShaper, to simplify polygons without slivers and it works well on small shapefiles. However, when I run it on a larger one (~150M, ~5000 shapes), it runs out ...
5
votes
2answers
660 views

Memory leak in ArcGIS Pro: in_memory workspace is not deleted

I have a python script for ArcGIS Pro 2.0.1 that executes the same code with the same data size in a loop. So intuitively the run times of the iterations of the loop shall be about the same. However, ...
2
votes
0answers
132 views

GeoJSON files using too much memory?

I have about/more than 400 GeoJSON layer files in my QGIS project. When I checked the task manager memory, it displays qgis.bin.exe *32 using about 1,334,000 of CPU memory. I had another version ...
5
votes
1answer
1k views

Insufficient memory for QGIS Raster Calculator?

I read related posts, but could not find an answer. I'm trying to perform an operation on two "light" rasters (80mg and 15mg), but get this error over and over. Any suggestion? This operation worked ...
3
votes
2answers
1k views

Error in raster Analysis in QGIS

I'm trying to conduct raster analysis in QGIS on a digital elevation model with a grid resolution of 5 cm. The disk size for the data set is 151 MB. When using default GDAL raster calculator it throws ...
1
vote
1answer
373 views

Duplicating memory layers in QGIS

I kept my original question clear and concise to make it easier to answer. This is a response to requests for more information. Introduction I am using QGIS version 2.18.9. I created about 20 new ...
0
votes
1answer
363 views

Raster Read Write Memory Issue in R

I am reading some EVI values from 46 raster layers (250 m resolution) 231 rows, 481 columns each and applying Support Vector MEachine (SVM) to classify using the training data stored in excel file and ...
3
votes
3answers
390 views

NetCDF to Raster: Dealing with Memory Leak

I have a short script that I am using to process roughly 5,000 NetCDF files so that I can extract a single raster layer. This is not difficult, and I have a short script that does it as follows: ...
2
votes
1answer
275 views

Measure Performance per layer in QGIS

I'm working in a relatively large project in QGIS 2.14, mostly loaded with .shp files. The issue is that lately got painfully slow when zooming or changing map view. I've tried to delete the largest ...
3
votes
2answers
285 views

Duplicate any active layer in memory using pyqgis?

I have seen Duplicating layer in memory using pyqgis? and I would like to do the same but for any active layer in the TOC whether it is a Polygon, Linestring or Point layer. Is it possible? This is ...
5
votes
2answers
2k views

How to remove memory layer from memory?

I have a plugin that creates a memory layer and displays it on the canvas. If I run the plugin a second time after removing the memory layer from the layer list panel without closing QGIS the memory ...
1
vote
1answer
55 views

ArcMap Renderer Memory Usage

I have two MXD files, both of them have one feature layer with unique value renderer and multiple values. Symbols are completely different but all of them are approximately 500 x 500 and 72 DPI. when ...
2
votes
1answer
79 views

Why when dump a layer to memory, initial record is 1, if in original layer was 0?

I load a layer from a Shapefile (featuresA) and duplicate its contents into a memory layer (featuresB). featuresA[0].id() is 0, but when copy his content to memory over featureB is 1, ...
5
votes
1answer
3k views

Saving vector memory layer to file using PyQGIS gives empty file?

I am learning to write standalone scripts with Pyqgis. I am trying to read a file with a big shapefile of polylines (64MB), create a memory layer, copy the features to, and save into another file ...
1
vote
1answer
256 views

ogr2og2 fails with memory allocation error post v2.0 for MSSQLSpatial

There are a few of us encountering "Memory allocation" errors when using ogr2ogr to import spatial (shp/gpx) data into a MSSQLSpatial databse. According to this post: Writing shapefile to SQL Server ...
2
votes
1answer
379 views

Memory leak while using in_memory ArcGIS 10.1

I am running a Python script to make point feature layer from a series of netCDF files and then perform a spatial join with a number of polygons and save the results as a table. I am using arcpy....
2
votes
1answer
390 views

Viewshed analysis plugin MemoryError in QGIS

I am very new to using GIS, and I am trying to do a viewshed analysis in QGIS 2.16.1. I have tried two different methods, one using the plugin for Viewshed analysis and the other using the GRASS (r....
2
votes
0answers
327 views

ArcGIS PRO Memory Leak Caused By Single Feature Class [closed]

I use a combination of ArcMap and PRO on a daily basis. It doesn't appear that many people are using PRO yet based on the lack of documentation online. All of layers are feature classes stored in ...
13
votes
2answers
4k views

Duplicating layer in memory using pyqgis?

I have a layer in QGIS, and I want to duplicate it through a plugin so I can use the copy of it as I want, without modifying the original. Of course layer2 = layer1 will not work, because everything ...
2
votes
0answers
488 views

Python/Arcpy Crashing [closed]

I am running a fairly large script where I export to a PDF. Now I added an export to Excel along with export to PDF from the same MXD. The Python window says python.exe has stopped working, ends then ...