Questions tagged [in-memory]
for questions related to the access and use of temporary data that is stored in memory
78
questions
2
votes
1
answer
34
views
GDal difference between VRT and MEM
I am working with many GDAL rasters in memory in Python. Users on forums suggest using either one of two formats; 'VRT' or 'MEM'. I am confused about the difference between GDAL's 'MEM' format and ...
- 101
1
vote
0
answers
98
views
rasterio memoryfile has no attribute profile
I am trying to write a function in rasterio that has equivalent functionality to a function I wrote in rioxarray. To avoid creating excessive files to the disk I am trying to use a MemoryFile, ...
- 11
1
vote
1
answer
67
views
Arcpy.CreateTable_management in Python toolbox not creating table in memory
The following creates a table in memory as expected when executed in the Python window [ArcGIS Pro 2.9, Windows 10]:
arcpy.CreateTable_management('memory','dataTable')
When I try to do the same thing ...
- 21
0
votes
1
answer
49
views
Arcpy.CreateTable_management fails in Python toolbox (.pyt)
I am trying to create a table within a Python toolbox (.pyt). This works with file GDB's, but I would like to use a memory dataset if possible.
A table can be created in memory manually or by calling ...
- 21
0
votes
2
answers
365
views
List datasets in the memory workspace in ArcPy
I have some sensitive data which I would prefer to only exist in memory that I wish to use in ArcGIS Pro. Loading the data into the "memory" workspace is no problem, and so is deleting it, ...
- 187
3
votes
1
answer
386
views
Adding memory dataset to current active map in ArcGIS Pro using ArcPy
I am using ArcGIS Pro 2.7.2.
I'm creating a Python script that creates data in the 'memory' workspace as part of a task. I would then like to add the dataset to the current active map as a manual QC ...
- 560
0
votes
1
answer
1k
views
Creating temporary layers in ArcGIS Pro
Is it possible to create temporary layers in ArcGIS Pro?
All layers seem to have to be created using the geodatabase format.
For example, if I want to buffer around a point do I need to create a new ...
- 143
0
votes
0
answers
92
views
Output IN_MEMORY for arcpy.analysis.Split()
I am using the arcpy module within the Jupyter Notebook to automate a sequence of ArcGIS tools. Most of the outputs I use are "in_memory", only the tool "arcpy.analysis.Split()" ...
1
vote
1
answer
170
views
Contours not saved [closed]
I have generated several bathymetry layers using the contour plugin. These are saved in memory. I have installed the memorylayer saver plugin which recognises the layers concerned. When I try to make ...
- 19
0
votes
0
answers
102
views
Failure deleting in_memory features ArcMap
Here is code and a function giving me grief. Unless issue is noticed specifically with merge and buffer, I am pretty sure my problem lies in the process of creating and overwriting (or deleting) ...
2
votes
1
answer
276
views
Writing table to memory in ArcPy gives ERROR 000354
Currently I try to improve an ArcPy script which is run outside ArcGIS Pro 2.5 in Spyder.
I want to write a table to memory using the Table to Table tool. This tool is placed inside a loop and writes ...
1
vote
1
answer
669
views
Cannot use in memory raster object with gdal warp (GDAL Python API)
These are the operations I am doing in my code:
reading an existing raster (tif)
creating a in memory raster object
reading the existing raster object in chunk as array
making some calculations
...
- 3,667
2
votes
0
answers
336
views
"Warning 1: All options related to creation ignored in update mode" (GDAL)
I am attempting to clip a raster using a polygon file (shapefile) and to save the result in memory. I succeed to do it using gdal.Warp and the option format=VRT using the following code. Please note ...
- 159
3
votes
0
answers
73
views
Using Spatial Join/Merge/Table View in ModelBuilder
I have developed a model that spatially joins a series of line segments to line and point segments using the "One to One", "Closest" function and creating a "distanceTo" ...
0
votes
1
answer
129
views
Euclidean distance raster fails with ArcPy script
I am working on a script tool to create watersheds.
Part of my process requires a distance raster from various features that I use in an equation to perform local modifications to my DEM.
I have been ...
- 880
3
votes
0
answers
887
views
Open feature class in in_memory workspace ArcGIS Pro SDK
I am aware that one can open a feature class in a geodatabase using the code below.
Geodatabase geodatabase = new Geodatabase(new DatabaseConnectionFile(new Uri("path\\to\\sde\\file\\sdefile.sde")))
...
- 426
0
votes
0
answers
20
views
Maintaining attributes in feature class in memory using ArcPy? [duplicate]
i am trying to feature to line conversion that are not multipart lines and Merge output feature class but its loses the attributes.
Here is my code:
arcpy.env.workspace="in_memory/"
with arcpy.da....
- 1,183
4
votes
2
answers
1k
views
Filtering above ground LiDAR points using a catalog in lidR?
I am analyzing LiDAR data collected two separate years- 2007 and 2015. My analysis is centered around changes in vegetation during this time period. The ultimate goal is to thin the data from the 2015 ...
- 155
0
votes
0
answers
143
views
Why is internal memory not overwritten?
I have the following code in Python for ArcMap to first select a property polygon and then with this selection to intersect the layer which contains lines (sewers) (which pass through or are within ...
- 1
1
vote
1
answer
511
views
Getting PNG binary data from GDALDataset
I have an in memory GDALDataset of driver type PNG. How can I get the binary PNG data to send to a web client without first writing the GDALDataset PNG to disk and reading it back as a binary file?
- 143
0
votes
0
answers
65
views
Performing raster analysis using Arcpy - in_memory does not preserve raster shape
I am creating a script tool using Arcpy and it transforms elevation data into a final clip polygon as part of a lengthy site selection tool. When I perform the raster analysis and save my intermediate ...
- 21
0
votes
0
answers
190
views
export pymssql query to geodatabase table
I have thousands of databases in Microsoft SQL Server and I want the user to select the server and DB they want so I cannot use arcpy.ArcSDESQLExecute
I am trying to use pymssql to connect to the ...
- 309
1
vote
2
answers
251
views
Merging feature classes in memory gives ERROR 001156?
arcpy.AddField_management("in_memory/originalfc","ALPHABET","TEXT",1)
arcpy.Select_analysis("in_memory/originalfc","in_memory/A","attr<=0")
arcpy.CalculateField_management("in_memory/A","ALPHABET",'...
- 1,024
1
vote
1
answer
99
views
arcpy doesn't save output from "Generate Points Along Lines" to "in_memory"
I'm trying to run the tool "Generate Points Along Lines" like this:
arcpy.GeneratePointsAlongLines(inputFeature,r"in_memory\temp","DISTANCE","100 meters")
when setting the output as "in_memory", an ...
- 117
1
vote
1
answer
250
views
Unable to Process Line Feature Class in in_memory Workspace
I'm trying to run a script that will generate a contour map from a raster in a geodatabase, run Simplify Line on the contour map, and then run Smooth Line. At first I ran it in disk, and it worked (...
- 25
1
vote
0
answers
48
views
Can in_memory act as a regular directory in the memory? [closed]
I am having trouble with raster clipping whenever the result is saved to a GDB,
is there any other way to geoprocess in the memory and have the results behave as if saved to a normal directory?
- 21
1
vote
1
answer
137
views
How to add GPInMemoryWorkspace to ArcCatalog?
I was trying to see if there was a way to visualize the data I am creating and placing in_memory and the help page mentions what the reference is named, but it doesn't at all instruct how to actually ...
- 9
1
vote
2
answers
108
views
Using in_memory in Python deletes values in field - Arcgis 10.4.1
I have a problem in using the in_memory function in a Python-script.
I have a shapefile test.shp with 3 fields (Alter, Geschlecht, Anzahl) and 2 rows of data. When I am using arcpy....
- 169
3
votes
1
answer
252
views
Using tempfiles for intermediate dataset in ArcPy?
I want to create a simple python arcpy script for ArcGIS.
Because in my script I have to many raster and shp where I need only to take
final result I try to use tempfiles for this unusually datasets....
- 1,089
1
vote
1
answer
331
views
Saving pyqgis QgsGeometryAnalyzer.dissolve output in memory?
How to save pyqgis QgsGeometryAnalyzer.dissolve output in memory (temporal layer)?
Usage example:
from qgis.analysis import *
shp_path = "C:\shape_file.shp"
QgsGeometryAnalyzer().dissolve(layer, ...
- 6,570
4
votes
1
answer
2k
views
Store bands in temporary file Rasterio
As I'm using multiple functions in one process, I would like to pass results of each function to the next one using an In-memory File. I'm using Rasterio and I saw that there is a way to create In-...
- 763
5
votes
2
answers
969
views
Memory leak in ArcGIS Pro: in_memory workspace is not deleted
I have a python script for ArcGIS Pro 2.0.1 that executes the same code with the same data size in a loop. So intuitively the run times of the iterations of the loop shall be about the same. However, ...
- 315
1
vote
0
answers
130
views
Saving focal statistics in memory using ArcPy?
I'm currently working on a project where I have written a script that is suppose to do several things. one of these is creating a "quick" focal statistics, from which I extract the values to some ...
- 447
0
votes
2
answers
394
views
Opening feature class created in_memory using ArcObjects?
How do you open an IN_MEMORY featureclass? The code below is not working:
IGPUtilities2 gpUtils = new GPUtilitiesClass();
IFeatureClass featureClass = gpUtils....
- 613
2
votes
0
answers
459
views
Using "Merge" with in_memory workspace with Arcpy in ArcMap 10.4
I am attempting to merge three tables, all within the in_memory workspace. The merge appears to work fine, but when I try to call the merged table, it cannot be found. I have isolated the issues to ...
- 1,006
1
vote
0
answers
96
views
Error 00358 when using arcpy.SelectLayerByAttributeManagement [duplicate]
All I'm trying to do is use SelectLayerByAttribute to select all lines less than 5.1 meters. However, no matter what query I try I keep getting
"error 000358 invalid expression" when I run the script ...
- 89
1
vote
1
answer
227
views
pgr_dijkstraCost() Many-to-Many exceeding RAM disponibility
I am working with PostGreSQL 9.6, pgRouting 2.4.1 and PostGis 2.3.1 on a Linux with 3Gb of RAM and 4Gb of SWAP.
I am trying to launch the following query :
SELECT start_vid as building, end_vid as ...
- 145
4
votes
1
answer
3k
views
Cannot delete in_memory workspace
I wanted to use in_memory workspace, however I can't clear it. No matter if I use in Python window, in ArcMap this:
arcpy.Buffer_analysis("something", "in_memory/buffer", 399)
arcpy.Delete_management(...
- 574
6
votes
1
answer
532
views
pyQGIS: load an in-memory (MEM format) raster as layer
Say I have an in-memory raster (i.e. a raster made by the MEM gdal driver), how can I load this raster into a QGIS layer? QgsRasterLayer's constructor wants a path to the raster file, but the in-...
- 161
0
votes
1
answer
147
views
Forcing table output by geoprocessing to be added to TOC?
In ArcMap I can set a Geoprocessing option to add geoprocessing output to my table of contents (Geoprocessing > Geoprocessing Options...)
If this option is enabled my script output will be added to ...
- 29.4k
4
votes
1
answer
542
views
Performing in-memory difference operation between vector layers in PyQGIS
I've been working on a project using QGIS's Python API. I need to create an in-memory layer that is defined as the difference between two polygonal vector layers, but I'm having difficulty figuring ...
- 154
3
votes
1
answer
355
views
Memory allocation error encountered when automating gridmetrics in R
I am trying to run Fusion's GridMetrics from R, I wrote this for one las file:
#First set up directories to keep the raw data
#separate from that produced by the analysis, Input (.las) and (.dtm),
#...
- 347
1
vote
0
answers
320
views
ArcObjects open an existing memory workspace [closed]
With .NET ArcObjects, I discovered that I could use an InMemoryWorkspaceFactory for my temporary feature classes. It is great, but I would like to know if there is a way to open an existing InMemory ...
- 395
3
votes
1
answer
210
views
Turning on metadata geoprocessing history for feature class after export/copy from in_memory workspace?
I usually run a series of geoprocessing tools by using in_memory workspace before saving a clean version of my feature classes. Most of the time geoprocessing history related to this final copy has no ...
- 4,913
5
votes
2
answers
908
views
Using CopyFeatures_management without copying source GDB domains to 'in_memory' workspace?
I know it's probably the opposite of what would generally be desirable, but I am trying to temporarily copy a Feature Class from a File GDB with Domains into a in_memory intermediate FC without ...
- 3,667
0
votes
2
answers
674
views
Executing cost distance in memory
Trying to run cost distance tool in ArcMap, but I keep getting the following results:
ERROR 999999: Error executing function.
("esriDataSourcesRaster.InMemoryRasterHelper") Failed because of out of ...
- 419
2
votes
1
answer
483
views
Memory leak while using in_memory ArcGIS 10.1
I am running a Python script to make point feature layer from a series of netCDF files and then perform a spatial join with a number of polygons and save the results as a table. I am using arcpy....
- 53
2
votes
1
answer
2k
views
How to list features "in_memory"
I have a script that creates a number of features "in_memory." Once I have them in memory I need my script to create a list of everything "in_memory" - I'm not sure how to achieve this. Is anyone ...
- 237
1
vote
1
answer
2k
views
In_memory workspace in geoprocessing services
I have a arcpy python script that runs a process that I publish as a geoprocessing service on ArcGIS Server 10.3.1. The python script uses various input feature classes. These feature classes are ...
- 442
3
votes
2
answers
2k
views
Out of memory when running ModelBuilder?
I'm currently using ArcGIS 10.3.1 on a 64 bit windows 7 machine.
When I run the following model, every iteration adds about 20 consistent megabytes into the ArcMap sessions memory until it eventually ...
- 61