When working with large amounts of raw input data for your analysis, how do you track data from different sources and covering different geographic extents to determine when you can proceed with the next step in your workflow?
My company works with LiDAR data for large electrical transmissions systems (thousands of miles in one project). We model the transmission lines and do analysis using CAD and GIS workflows. We break the system into lines or circuits (1-150 miles each) in order to process the data in smaller units. The LiDAR data itself is broken up into blocks (less than 1sq mile). We always struggle with tracking which blocks have been delivered and which lines are ready for the next step in our workflow.
Has anyone had any experience tracking input data like this? Do you know of any software platforms out there designed for this particular task?
I appreciate any advice you can throw my way.