I am working on streamlining data processing at my organization. Currently we are using various large-scale Models that we will gradually bring into Python.
The gist of our data processing is as follows:
- Collect data from sources (State, County, City, etc.)
- Project all data to a common coordinate system.
- Perform all sorts of processes on the data.
I am currently concerned with part 2. The data comes in various coordinate systems. Our previous Models would run the ArcGIS Project tool individually on each dataset that needed it. Each Project tool in the Model would be projecting to the same output coordinate system, but some may require different transformation methods (or none at all).
You can imagine having about 70 different datasets whose transformation methods are each manually assigned. It's ugly in code, worse in ModelBuilder. Most importantly, it is hard-coded to those specific datasets and therefore not reusable by another collection of datasets. Ideally, I want to be able to choose a bunch of datasets, point them to a script tool, and reliably output them all in the same coordinate system.
I thought of importing all of the datasets into an ArcGIS Feature Dataset which will project all of the data automatically, but as blah238 pointed out in my previous question, it could be unreliable since it makes a 'best guess' on the transformation methods.
Are there any better methods, or any known tricks or custom tools? My organization is mostly in the Esri world, but I'm open to open-source solutions as well.