Questions tagged [data-management]
concerns the methodologies and processes for managaing geospatial data
99
questions
4
votes
2
answers
269
views
What is the format of these data files? CNT, LAB, PAL, etc
I was given data which is arranged in folders as shown in the following picture:
I am using ArcGIS 10.1. I believe feature datasets in ArcGIS only exist in geodatabases. But the datasets are arranged ...
1
vote
0
answers
273
views
What is the recommended way for team coordination in GIS (ArcGIS, QGIS, etc.) [closed]
I am preparing a team of around 18 GIS analysts to work on 12h/12h work cycle to attain 24h/day work rate. This means two 9-person teams, one for each period.
All analysts will have access to various ...
2
votes
1
answer
155
views
Creating random points in vectorized raster in ArcGIS for Desktop?
Im conducting an accraucy assessment of an NLCD map. First, I wanted to create a few points in each land cover category in Arc, convert it to kml format, then pull it into Google Earth to make sure ...
1
vote
0
answers
208
views
Spatial decision support tools for spatial planning, licensing, and permitting, alternative to FlexiCadastre? [closed]
I'm tasked to design and develop an information management system, i.e. GIS-based spatial decision support system to guide, inform, evaluate, and monitor regulatory processes in spatial planning, ...
1
vote
0
answers
278
views
netCDF import problem in QGIS (XY issue)
I working with a netCDF file related to precipitation over time in QGIS. When I import the file, QGIS reads the data indicating y-coordinate, instead of timestep, as the dynamic dimension to associate ...
4
votes
2
answers
887
views
Best practise for managing shapefiles/symbology in QGIS
One aspect of GIS that wasn't covered in my training was the best way to manage shapefiles within a project.
In my hypothetical example I have a shapefile with a number of attributes. I want to ...
-1
votes
2
answers
116
views
Can I change the pimary key for feature class comparisons with ArcPy
I'm using ArcPy to compare two feature classes from Esri file geodatabases using the Feature Compare (Data Management) tool.
The script itself works very well. However it always uses the OBJECTID to ...
1
vote
2
answers
2k
views
ArcGIS Tool to Delete only Geodatabase content (feature classes, tables, etc)?
Situation:
Need to add a Tool to my ModelBuider to Delete only the content from an Enterprise (SDE) Geodatabase (containing features classes, tables, relationship classes).
Tool "Delete" (from ...
0
votes
1
answer
1k
views
Copy shapefile to SDE feature class using arcpy
Is it possible to copy shapefiles to SDE geodatabases using ArcPy? I have tried using Copy_management, but it says that it cannot copy between different workspaces. Is there a different function that ...
1
vote
1
answer
320
views
Cannot find table in geodatabase
I was using the Make Query Table tool in ArcGIS. Once the tool finishes running, the result (a table whose name I specify) is automatically added to the Table of Contents and I can view the data ...
2
votes
0
answers
59
views
Geospatial Projects Management System/Software for multiple concurrent Projects [closed]
I'm looking for a System/Software for managing multiple (20+) Academic Researches and Projects.
Due to a large number of active projects lately, which many of consist of the same geographical ...
1
vote
1
answer
136
views
CalculateField_management: Different results than in the field calculator
I`m using ArcMap 10.2.2 and Python 2.7.5
I´m tryig to calculate values with the CalculateField_management tool.
my script:
def mthree(mthre, mtwo):
if mthre >= 1:
return -3
if ...
2
votes
3
answers
3k
views
Collapse dual lines to centerline doesn't exist in ArcGIS Pro?
I have ArcGIS Pro build 3308 (Ver. 1.1) and wish to collapse two parallel lines into one, however it appears that this function no longer exists - I have also tried using python for this and received ...
1
vote
1
answer
595
views
Preserve input attribute schema option NOT working when using Feature to Polygon in ArcGIS
I have successfully converted a polyline fc with 1,780 records into a polygon fc in ArcGIS 10.1, by using the tool: Feature To Polygon, but the output does not keep the attributes of the input fc (I ...
2
votes
2
answers
1k
views
Ignoring field types in Python list returned by arcpy.ListFields()?
I am generally just wondering if there is a nice and easy way in python to ignore all fields of a specifiy type (eg string) in a feature class.
At the moment I am doing it with
field_names = [f....
2
votes
1
answer
3k
views
Change field names automatically
I have an attribute table with over 2500 fields. About 2000 fields start with the name "All_txt_" (eg "All_txt_Watermelon").
Is there a way to remove this "All_txt_" from all the fieldnames ...
4
votes
1
answer
209
views
From hundreds of shapefiles to PostGIS with some kind of directory/file structure
We have more than 700 shapefiles which we will import in a PostgreSQL/PostGIS database.
We want to use a single database to make joins on our tables without using foreign database wrapper.
Our data ...
1
vote
1
answer
475
views
Maintaining CAD drawings and Esri Geodatabase simultaneously?
I'm wondering if there is a best practice for maintaining both CAD and ESRI GDB sytems simultaneously?
I work for my local municipality and as it is now the Eng Techs update reference drawings in CAD ...
2
votes
1
answer
106
views
Windows' Offline Files for GIS projects?
I'm about to start yet another project which will consume and produce several to tens of GB of data. For efficiency, performance, and source code control* I want to do everything on the local machine. ...
2
votes
2
answers
1k
views
How to find number of synchronized records in ArcGIS10.2.2 (Data Management)
I want to find number of records synchronized while using arcpy.SynchronizeChanges_management tool. Right now, I'm getting only messages like process is Executing, Synchronize successfully completed......
0
votes
0
answers
170
views
Is it possible to "re-buffer" river polygon dataset? [duplicate]
I've river polygon data representing the water quality. This polygon data were derived from polyline dataset according to a buffer distance in the attribute table. Unfortunately I don't have this line ...
3
votes
0
answers
171
views
Merge shapefiles to one tool not working?
When using the data management tool "Merge shapefiles to one" in QGIS why is it copying one of my shapefiles instead of merging the two together as it should?
1
vote
1
answer
657
views
Error in Creating Line from Points
I am trying to create coastline of an area by joining about 20,000 points using Data Management Tool "Points to Line" in ArcGIS 10.1. But it seems that the inbuilt algorithm is not recognizing the ...
7
votes
3
answers
8k
views
How to Receive an Email after a script has run?
I'm working my way through my first attempt at scheduled tasks with modelbuilder and python. So far I have:
Created a model that reconciles our SDE versions and then compresses the database.
Exported ...
2
votes
4
answers
2k
views
Append operation in ArcGIS
I have 250 road shapefiles, I have to append all the 250 shapefile into one single file. I have used ArcGIS append tool for combine layers (if number of shapefiles are minimum), but these 250 ...
2
votes
2
answers
427
views
cutting and extending one polygon layer in function to the other layer boundaries
I'd like a methodology that can edit my vector layer, extending and cutting the features in the polygon layer "cap_agricola" within the boundary layer "sp_edr", I would like to solve this problem in ...
2
votes
1
answer
962
views
Create a subset of a dataset with a specific grid size in ArcGIS using Data Management Tool
I am wondering how you can create a subset of a dataset that is a specific grid size (in pixels) using the Clip tool within the Data Management Tool box for raster data.
I was trying to find a hint ...
6
votes
1
answer
1k
views
When to use multiple geodatabases?
I'm working on a project involving one database , but the customer's needs have evolved, so he needs to manage multiple projects. I tried to work with adding an id for each project, which gave me more ...
2
votes
1
answer
663
views
Data management in GRASS from command line?
I'm trying to import a large set of raster files into GRASS. The GUI import tool works fine for a handful of files, but it appears to require that I click the "Layer id" checkbox for each individual ...
12
votes
2
answers
16k
views
Removing rows in shapefile in R
I've imported a shapefile into R, and joined it to a table. My shapefile contains all the census ids, while my table only contains selected census ids. I'm now trying delete all the rows didn't get a ...
1
vote
1
answer
1k
views
Alternatives to Windows Explorer and ArcCatalog when copying a file gdb
I need to copy a file gdb from my local machine to a server using a remote desktop connection. I have been doing this using a simple copy/paste operation in Windows Explorer. I know that it is best ...
9
votes
2
answers
736
views
Tools to compare unversioned copies of geospatial data [closed]
My office has about 100 GB of geospatial data of varying forms (imagery, feature classes in geodatabases, LIDAR, tables, etc) that have gone somewhat unmanaged for the decade during which they were ...
3
votes
1
answer
236
views
How to recategorize features in GRASS by geometry, like the ArcGIS Sort tool?
The ArcGIS Sort tool creates a new feature class with features sorted by geometry. For example, it can number features IDs from north to south, etc. Is there a way to renumber the cat field in a GRASS ...
2
votes
1
answer
240
views
How do I select all polygons in a layer that border 2+ polygons in the same layer?
My data consists of equal-sized polygons. I need to identify and select all the polygons that border two or more polygons.
14
votes
1
answer
583
views
Open-source software for managing terabytes of different formats of geospatial data?
I have a problem that I am sure many GIS Teams or Departments have which is how to find, keep track of and manage multiple different datasets from multiple sources. I have read the responses from a ...
16
votes
2
answers
4k
views
Storing and managing spatial data? [duplicate]
I have always been curious how other folks are storing their spatial data.
Outside of an enterprise environment where much data is stored in enterprise geodatabases, is it better to store data per ...
1
vote
0
answers
47
views
Managing outages to make ArcSDE updates?
I would like options to manage ArcSDE outages for making updates to schema, which I am not able to do when users are just reading the feature classes. I would like to not have to stay late to get ...
3
votes
2
answers
4k
views
Is there a browser/management view in QGIS?
Is there a browser/management view in QGIS 1.8 so that I can manipulate shapefiles and others (such as geo tiffs, etc.) like in ArcCatalog? Maybe a plugin? Right now I have to use my system's file ...
1
vote
1
answer
245
views
Tracking which LiDAR data tiles have been delivered?
My company works with LiDAR data for large electrical transmissions systems (thousands of miles in one project). We model the transmission lines and do analysis using CAD and GIS workflows. We break ...
3
votes
4
answers
2k
views
XY to Line not converting all 58,000 records using ArcMap
I have a dbf (and xls) that contains ~58,000 records of latitude and longitude for both start and end points. I would like to connect each XY coordinate pair using the XY to Line tool found inside the ...
4
votes
4
answers
3k
views
When a raster is clipped to a polygon with Python, why does it still take on the extent of the entire shapefile?
I am clipping a raster image to each polygon row in a shapefile in ArcMap 9.3 using the Clip tool (Data Management) in Python with Clipping Geometry set. While the clipped raster successfully depicts ...
4
votes
1
answer
534
views
Sort by geometry using INHERITS?
hope everyone's doing well.
I have a statewide point data set (parent table: 600K rows, 500 columns) I need to analyze at multiple scales based on several different spatial divisions. I'll also need ...
1
vote
5
answers
317
views
GIS software to manage assets [closed]
How do you manage the following projects (i.e. what GIS software / platform would you use)?
An extensive Footpath Construction & Renewal Program
Improved drainage systems at x Street, y Street, ...
7
votes
0
answers
658
views
Qualifications auditor should have to audit GIS [closed]
Background summary: Various systems are being audited and GIS is the next to be audited. The initial kick-off for the audit was a meeting between me and a single auditor. Initially, I thought it was ...
10
votes
4
answers
1k
views
How do you manage existing GIS data and allow for integration with an Asset management system?
I am using ESRI based GIS software, Postgresql/PostGIS/ArcSDE DB and we have a Mincom Ellipse asset management system.
Currently our all our spatial information regarding asset sites have been ...
11
votes
4
answers
5k
views
Employing file geodatabase that is going to be used and edited by multiple users [closed]
I have a file geodatabase that contains 3 feature classes in it and each feature class contains a lot of data that will be viewed and edited daily by 6 other users. I am looking for any advice from ...
4
votes
2
answers
1k
views
TIGER/Line processing
Does anyone know of scripts for merging TIGER/Line shp files? It is for extracting the road features only, but for the whole of USA.
They are provided as shp files for one county at a time here:
http:...
4
votes
1
answer
303
views
How to limit the number of items to enter metadata on when importing from GeoServer into GeoNetwork
We are a library looking at using GeoServer and GeoNetwork as the basis of a GIS repository/catalog. When we enter layers in GeoServer and then harvest using GeoNetwork, we end up with a large number ...
87
votes
8
answers
12k
views
Managing large amounts of geospatial data? [closed]
How do you manage your geospatial data? I have terabytes of data spread out over hundreds of datasets, and have an ad-hoc solution using symbolic links within projects which link back to an domain-...