Take the 2-minute tour ×
Geographic Information Systems Stack Exchange is a question and answer site for cartographers, geographers and GIS professionals. It's 100% free, no registration required.

I have a large (1GB+) raster that I am using as the base for the generation of an equipotential surface. This is to assess the accuracy of DEMs derived from another source. In situ observation is impossible and the equipotential surface allows me to model in error.

I have an ArcGIS model that generates a single realization of the surface. The model is outputting beautifully and generates a 1GB raster realization. I am going to generate 100 of these surfaces to start to build a statistically significant pool of realizations (Monte Carlo simulation).

How would you go about storing the rasters? How would you visualize them to allow for the selection of the most likely realization (the one at the center of the monte carlo significance envelope)?

Here are the options I have considered and I would appreciate any input, links to papers, etc.

  1. Convert to point and store each realization as a column in the attribute table. Here I am concerned about the shapefile size limit (2GB).

  2. Convert to CSV using gdal2xyz. I tried the conversion and the output of a single raster was 12GB! This is way too inefficient.

  3. I considered using R but am not sure which package would facilitate this type of research (spatstat perhaps).

  4. Graph either the histograms or cumulative distribution functions of each raster realization for visual identification.

share|improve this question
If this two year old Question is something that you are still keen to try and get Answer-ed then you may want to edit it, perhaps to revise it to try and make it more focussed and/or make what you are asking even clearer. –  PolyGeo Apr 5 '14 at 0:52
I wonder if attracting any answers to this question could be helped by splitting it into a question for each of its two parts? One about storage and the other about visualisation. –  PolyGeo Jul 5 '14 at 23:32
While my research focus has shifted significantly, I can now answer this if it of interest to other users? –  Jay Laura Jul 7 '14 at 16:50
It would be great if you could provide an answer, even if only at a high level. At the moment it is the highest voted but unanswered question tagged arcgis-desktop so there has been interest. If more interest is shown then you can perhaps provide a more detailed answer later. –  PolyGeo Jul 7 '14 at 22:47
I've done the inverse in R, sampling from a known distribution around the values from a raster. Mine was much smaller and some of the cell values were the same so I was able to generate matrices with each unique value for cells (column) along the probabilities for those values (row) and then join those back to the original locations. Another possibility might be to discretize your results to store counts for ranges rather than unique values. I'm curious to hear what your final solution was. –  jbosq Oct 23 '14 at 1:39

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.