difficult to process and manage because the size is usually bigger than the limits software can normally deal with.

learn more… | top users | synonyms

19
votes
9answers
11k views

Bulk Geocode 20 million records

Are there any free or reasonably priced databases for the US which can be searched and return latitude and longitude information?
20
votes
2answers
6k views

Looking for fastest solution for Point in Polygon analysis of 200 million points

Apologies for asking a question that has been asked before -- I've read through answers, and I'm left wondering how to implement the recommendations. I've never used SQL, Python, C, and have only ...
9
votes
2answers
3k views

Is there a difference in performance between Merge and Append in ArcGIS?

Often I find myself in a situation where I don't care whether or not my tool produces a new feature class, but I do care how long it takes to combine all of my large datasets. Does it take longer to ...
8
votes
4answers
1k views

Queries returning very big datasets in PostGIS

I have a PostGIS query that will return several million rows: SELECT t1.id AS id1, t2.id AS id2, ABS(t1.mean_h - t2.mean_h) AS h_diff, ST_Distance(t1.the_geom, t2.the_geom) AS dist FROM ...
7
votes
9answers
1k views

WMS with Access Control (ACL) for different users? Or solution for thousands of points on web map?

I have a set of Sites in the thousands. Not all users see same the same Sites on the map - thus ACL. Data is stored in a non-GIS database (mssql, ora, etc) and right now is retrieved with a standard ...
5
votes
2answers
643 views

memory issue when trying to buffer/union large dataset using postgis

I am trying to generated a dissolved buffer of a large point dataset (Ideally 29 million points - Address data in Great-Britain, but I receive the data by chunks of 1 million points, so these could be ...
1
vote
0answers
57 views

How to Buffer with Dissolve ALL on very large polyline dataset? [duplicate]

So I have a fairly large polyline network covering a decent chunk of North America, containing just shy of 900,000 table records. I want to do some very simple "GIS 101" kind of processing to it -- I ...