Timeline for NumPy memory error on large rasters
Current License: CC BY-SA 4.0
15 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Aug 8, 2018 at 1:23 | vote | accept | Sourav | ||
| Aug 7, 2018 at 10:54 | history | edited | Vince | CC BY-SA 4.0 |
Title clarity
|
| Aug 7, 2018 at 10:49 | comment | added | Vince | Install 64-bit Background Geoprocessing, which will give you a 64-bit arcpy and a second Python install with numpy. | |
| Aug 7, 2018 at 10:08 | answer | added | FelixIP | timeline score: 1 | |
| Aug 7, 2018 at 9:25 | comment | added | Hornbydd | Reading the comments/replies it is heavily pointing to the issue of limitations with memory. You say nothing about what the rasters represent and what their range of values are? I don't know if they are bands from a multispectral or the end result of a land classification? What I do feel is very odd is the insanely large no data value of 10000000000, why does it have to be that? why can't it be -1? That would consume less memory storing that number... | |
| Aug 7, 2018 at 5:57 | comment | added | user2856 | Please don't add additional info (i.e. the dimensions (bands, rows, cols) and datatype) as a comment, edit your question. | |
| Aug 7, 2018 at 5:45 | answer | added | Mike T | timeline score: 4 | |
| Aug 7, 2018 at 5:35 | comment | added | Sourav | I am going to run them separately. Let's see what happens. | |
| Aug 7, 2018 at 5:34 | comment | added | Sourav | They have the same size. single band, (16963, 11367) | |
| Aug 7, 2018 at 5:30 | comment | added | Michael Stimson | What happens when you run each image in one process? Does it still give the memory error on the same raster? i.e. is it the iteration or is it the data that's likely at fault here. | |
| Aug 7, 2018 at 5:26 | comment | added | user2856 | What are the dimensions (bands, rows, cols) and datatype of the rasters? | |
| Aug 7, 2018 at 5:19 | comment | added | Sourav | @MichaelStimson I have added the error message. | |
| Aug 7, 2018 at 5:18 | history | edited | Sourav | CC BY-SA 4.0 |
added 410 characters in body
|
| Aug 7, 2018 at 4:56 | comment | added | Michael Stimson | 32 GiB of ram is meaningless to ArcGIS, it's still a 32bit process and thereby subject to 4 GiB maximum RAM allocation. What is the memory issue? if there's an error message I'd like to see it. If it takes 3 rasters before it fails try running them one at a time as a process and let Windows settle down between each one. | |
| Aug 7, 2018 at 4:37 | history | asked | Sourav | CC BY-SA 4.0 |