Pretty common use case I suspect, but want to make sure I optimise from the get go. PostGIS I'm suspecting is the weapon of choice, and one way I'll be interrogating data is QGIS. Large part of data set originally sourced from LAS files.
Raw Data comes as typically 3 tables:
- collars/wellhead - point data of well head xyz ,
- wellpath - linestring data, dip/azimuth surveys at regular intervals, puts well/borehole in 3d space
- geophysics - 1d data, regular intervals along welpath like M values, up to say 15 parameters per depth step. Typically all 20 params at same intervals.
Size is an issue (well, for me). Given most of the data is by definition at regular intervals, say 1cm, I thought there must be some standard functions that could make the storage retrieval efficient. I'm aware of things like ST_LineLocatePoint
- collars - 3000 xyz points
- wellpath - 30 dip/azi points per collar, regular 10m intervals
- geophysics - 50000 rows per collar, regular 1cm intervals (CWS Las 1.0), 20 single precision observations per intervals.
A typical csv containing the above weighs in at 10gb. Nice to have appropriately indexed, hence the question. Its the regular 1cm interval data that is the bulk that I'd like to have indexed appropriately.
