Questions tagged [geoprocessing]

Geoprocessing is a GIS operation used to manipulate GIS data. If you are performing geoprocessing using ArcGIS then the tag Geoprocessing-framework is specific to that software and should be used instead.

Filter by
Sorted by
Tagged with
69
votes
11answers
11k views

Alternatives to using Arcpy

I seem to use ESRI's Arcpy site package for virtually all of my python geoprocessing. To ESRI's credit, these are an incredible suite of tools that can help accomplish a great deal. However, I would ...
39
votes
8answers
15k views

Select features that do NOT intersect in PostGIS

This seems to me like such a simple question (and it probably is) yet I cannot seem to find an example that gives me the answer. Using PostGIS, I just want to select points that fall outside of ...
34
votes
2answers
2k views

Streamlining Python Code for Big Data

I have Python code which is designed to take point shapefiles through the following workflow: Merge points Integrate points, such that any points within 1 m of each other become one point Create ...
33
votes
10answers
6k views

How to easily shift all features in a vector dataset?

Let's say that I put together a Shapefile and all the features have their vertices shifted by a constant amount. What's the easiest way of shifting all the features (hence the (x,y) position of their ...
33
votes
4answers
37k views

Python Script examples for geoprocessing shapefiles without using arcpy

I would like to use a Python script that is not based on arcpy to do things like query a shapefile by attributes, create new layer from selection, and calculate areas of a polygon and convert ...
25
votes
10answers
6k views

Existing solutions to automate generalisation/simplification of geographical data?

I am looking for existing solutions (softwares, libraries, methods, etc.) to automate the generalisation/simplification of geographical data as presented there, and also there. Do you know and use ...
24
votes
8answers
2k views

Is there an architecture for distributed geoprocessing?

Suppose I have 50 computers on my LAN. Each computer has a geodatabase for all parcel polygons in a particular state in the US. I'd like to write a geoprocessing task that finds all parcels valued ...
22
votes
6answers
17k views

What LiDAR processing tools are available in Python?

I have been using FUSION and the command line FUSION Lidar Toolkit (LTK) to process LiDAR data. A broad Google search ("Lidar Python") yielded libLAS and pyLAS as Python LiDAR libraries, however, ...
22
votes
2answers
364 views

Ways of expressing geographic questions in machine readable form

A core concept of GIS is answering questions about datasets. From the point of view of a database; SQL with spatial extensions is a way of asking such questions. What other ways can questions be ...
18
votes
3answers
1k views

Using GIS tools for non-geographical problems

Many other fields have visual/"spatial" problems that can potentially be solved with GIS tools. I know I've used GIS tools for the odd non-geographical task and was wondering how much this happens and ...
17
votes
3answers
4k views

Is there a way to automate the preprocessing of LANDSAT data?

I'm currently enrolled in a remotesensing course, using LANDSAT data. Part of my course is about standardizing the scenes based on radiance values. I assume that because this is such a tedious task, ...
16
votes
4answers
811 views

How to handle TIME in GIS?

Is there any way or any idea on how to handle Time attribute in GIS? For example, which are the ways to specify that an object is at a place at a given time interval and them it is in another place ...
16
votes
4answers
25k views

Automated/geoprocesing tool to slice, clip, or cut polygons using polylines using ArcGIS Desktop? [duplicate]

Looking for a simpler method here. I am trying to split up / cut / slice existing polygons by using existing poly-lines. An example would be splitting a water body or land parcel at the point where a ...
15
votes
6answers
1k views

PostGIS: Assign ID of point in layer A to closest point in Layer B

This should have been an obvious precursor (that I didn't ask) to my other question: How to create spider diagrams (hub lines) in PostGIS? If I do not know the relationship between a point in layer A ...
14
votes
4answers
5k views

In FME, is there a way to connect multiple input feature types from reader and route to single transformer?

In FME, is there a way to connect multiple readers to a single transformer? I'm using FME 2015 and want to clip a bunch of feature classes to a single feature, but can't seem to find an easy way to do ...
14
votes
2answers
4k views

Avoiding fails from ArcObjects geoprocessing with .NET?

There are some nice features in ArcToolbox we can use, but for some reason, this is NOT working properly. It doesn't even throw me an error. My software is running inside ArcMap, so no need to ...
14
votes
2answers
4k views

How to import esri Personal Geodatabase (.mdb) to PostGIS on Linux

We have esri Personal Geodatabases that we need to import into PostGIS. Ultimately, we'd like to allow people to upload an MDB on a web server, and have it import the layers into PostGIS. On ...
13
votes
3answers
540 views

File organization for sharing ArcGIS python code

What is the best organizational structure for sharing ArcGIS python code and geoprocessing tools? Or even, are sharing code and sharing tools separate questions? Esri has a Methods for distributing ...
13
votes
1answer
3k views

Displaying raised error messages to user in ArcGIS Geoprocessing Results window?

Can print statements raised from a custom exception be displayed in the Geoprocessing Results window? I modified a script that I found that takes two inputs from a user, finds the associated feature, ...
12
votes
1answer
12k views

Is Clip (Data management) or Extract By Mask (Spatial Analyst) more efficient?

I'm trying to clip down an Orthophoto to a county boundary. I've been using the Extract By Mask Tool, but this process has been running for about 12 hours! It's gone through 2 cycles already, so I'm ...
12
votes
4answers
2k views

How to use PostGIS to handle complex geoprocessing workflows?

Our organization is considering moving our geoprocessing workflow to PostGIS. We are currently using ArcGIS, with a plethora of custom Python tools used in ModelBuilder. We're moving most of our data ...
12
votes
4answers
598 views

Mirror of Michigan State University's Python geoprocessing course materials

Been learning geoprocessing with Python using MSU's GEOG 825 ( python geoprocessing ) course. Unfortunately the link is dead now. I know this is a long shot but does anybody have a copy of the ...
12
votes
3answers
1k views

How can I use ArcGIS 10.1 to find a geodesic equidistant point defined by three points?

For example, I have coordinates for three base points on a coastline and I need to find the coordinates of the point off the coast which is equidistant from all three. It’s a simple exercise in ...
12
votes
2answers
2k views

TRI, TPI, or Roughness

I am working on a site selection projection where I will be unable to perform any in situ observations. A key component of the selection process is the ruggedness of the underlying terrain. I plan ...
12
votes
4answers
9k views

Finding Clusters of N Points Within X Distance using ArcGIS Desktop?

We have tried two methods of cluster analysis: Cluster and Outlier Hot Spot ... but neither meets our specification which has these 3 parameters: a Set of Point features N points within a Cluster X ...
12
votes
3answers
10k views

How can you tell if ArcCatalog Geoprocessing is still running?

Is there some other way other than the logs to check that ongoing geoprocessing is working correctly? I am running the Buffer tool with dissolve type ALL on ArcCatalog 10.1. I was expecting the the ...
12
votes
0answers
698 views

Writing Python script for ArcGIS to square polygon corners? [closed]

I'm looking for a script that will square the corners of polygons that are near 90 degrees but not exactly. Near could be dealt with via a variable, for example within 5 degrees of 90 (85 - 95 degrees)...
11
votes
5answers
25k views

Creating polygons around extent of similar points using ArcGIS Desktop?

I've millions of points collected for lithology layer. They have used a coding for different types of rocks. I need to create a polygon around the extent of similar points. What is the easiest ...
11
votes
5answers
1k views

Background reading on using GPUs for GIS?

I'm interested in the emerging intersection between GIS systems and GPUs, which can provide orders of magnitude improvement to certain classes of GIS problems. Do you know of any good resources ...
11
votes
4answers
12k views

What ArcGIS geoprocessing tools support exporting tabular data to CSV?

I have found that most if not all geoprocessing tools that allow tabular output are limited to geodatabase tables and DBF files for supported output formats. Are there any that also support CSV output?...
11
votes
1answer
4k views

How to achieve equivalent to Dissolve from ArcGIS for Desktop using ST_Union?

I am trying to achieve an equivalent to the Dissolve tool from ArcGIS for Desktop using ST_Union from PostGIS but it seems I am not getting expected result. I have one table which has certain ...
11
votes
2answers
9k views

Finding differences between shapefiles using ArcGIS for Desktop?

Every month I have to QA/QC some streets data for an entire county (over 47,000 records). The first step is to compare the two files. Currently, I'm using a tool that was created in house via VBA ...
11
votes
1answer
915 views

How do I identify and gracefully kill hung Gp service processes?

I've published a gp tool as an asynchronous non-pooled gp service. When the gp tool hangs I would like to allow the user to kill it, without impacting other services. If I put a webservice on the ...
11
votes
1answer
958 views

Creating groups of points from lat/long pairs using R?

I have a database which contains Lat/Long pairs to identify the location of points of interest. I would like to group the points of interest into groups of 10. The group should be geographically ...
10
votes
3answers
13k views

Log file for ArcGIS geoprocessing?

Whenever I run a geoprocess overnight, it seems my computer reboots. Does ArcGIS save some log file information? Where does it save it? For example, when I run a large dataset or image process I need ...
10
votes
2answers
4k views

Is there a Free Aggregate Points tool out there for ArcGIS 10?

I need to do some Getis-Ord analysis but first I need to aggregate my points. I know of XToolsPro, but the aggregate points function is locked and you must purchase a license to use it. I am ...
10
votes
4answers
2k views

To what extent is SQL's language accessible via ArcGIS tools?

That question just sounds so redundant... At any rate, I have been asked to explore the uses of SQL in ArcGIS. We use an SDE DB for all server-side storage and DB managing/large-scale editing. However,...
10
votes
4answers
1k views

Finding clusters of one set of points around another set of points from different layer?

I want to see if there is clustering of a certain type of buildings (x) around another type of buildings (y). The two point files are in different layers. I cannot figure out which tool I would ...
10
votes
2answers
564 views

Ocean flow models - predict the path of an object dropped in the ocean

This question is from a user who wants to calculate the predicted path of a bottle dropped from a ship. He has a spreadsheet of hundreds of these bottles and wishes to display the predicted vs actual ...
10
votes
3answers
7k views

Enabling multithreaded processing in QGIS?

I have found multiple links that appear to say that this now exists in QGIS 2.2, but it appears that it's only using one core to full capacity. This is running on Ubuntu 14.04 The current process is ...
10
votes
1answer
6k views

Explode MULTILINESTRING into individual segments in PostGIS 1.5

I have a MULTILINESTRING in PostGIS consisting of several LINESTRING's. Consider each LINESTRING to have a set of POINT's P1, P2, ... PN forming the line segments L1, L2, ... LN-1 where LX is ...
10
votes
7answers
8k views

Linux alternatives to visualize and analyze LiDAR datasets?

For a long time I have been using softwares based in Windows to visualize and analyze LiDAR data sets for forest application. Recently, I have started to move all my work to Ubuntu platform, but I'm ...
10
votes
2answers
357 views

Determine minimum number of polygons from shapefile to cover an area of interest

I have a large number shapefiles representing areas of interest for an analysis that will be conducted using various sources of satellite imagery (IKONOS, RapidEye, etc.). Unfortunately, the imagery ...
10
votes
1answer
203 views

Create points at specified distance from each other in random fishnet's cells while being on linestrings

We have a land protocol where we receive a fishnet of 1x1 km cells. Some cells are randomly choosed. We need to put 4 points in each cell and these points have to be on a road too. The minimum ...
9
votes
8answers
6k views

Maximizing the use of CPU

My script is intersecting lines with polygons. It's a long process since there are more than 3000 lines and more than 500000 polygons. I executed from PyScripter: # Import import arcpy import time # ...
9
votes
3answers
9k views

Why is it important to use feature layers in ModelBuilder?

I am trying to understand creation of a geoprocess with ModelBuilder, but I don't know why it's important to use feature layers instead of feature classes when creating a geoprocess with ModelBuilder. ...
9
votes
3answers
766 views

Making county-level shapefile from set of points at 30 x30 km spacing using ArcGIS for Desktop?

I have a data set in csv form, like: latitude, longitude, value -45, 45, 10 .... I would like to calculate county level means from these data, using either ArcGIS or R+grass. I have the ArcGIS USA ...
9
votes
2answers
7k views

What is “Simplify tolerance” in QGIS's Simplify geometries tool?

I am trying to use QGIS 2.8 to simplify vector geometries. But I do not understand the significance of the Simplify tolerance value in the Simplify geometries tool. The documentation does not ...
9
votes
3answers
2k views

How to determine on which side of a line a polygon feature falls?

I have parcel data intersecting line data. In the parcel data there are some parcels that don't intersect the line. How could I programmatically figure out if the non-intersecting parcel is on the ...
9
votes
1answer
11k views

How to increase maximum memory usage cap for running Arc 10.1?

Not sure if this is strictly GIS related or perhaps belongs on StackOverflow...it is regarding ESRI ArcGIS 10.1, so I'm sticking it here. I'm looking for options to increase processing capacity, and ...