ETL (extract, transform, load)

learn more… | top users | synonyms

0
votes
0answers
17 views

ArcGIS - Spatial ETL Tool - Checking fields in input shapefile

How to check if the input file fields have the expected name and type? Which transformer will be useful to validate names and types of attributes of reader. edit: I have a shapefile that transforms ...
0
votes
1answer
34 views

Spatial ETL Tools won't run “AttributeError: 'module' object has no attribute, etc.”

I have a python script that runs 5 Spatial ETL tools that I wish to run as a scheduled task. Each of the tools will run successfully from ArcCatalog and also from the ArcCatalog Command line. If I ...
2
votes
1answer
41 views

How to transform JSON with field x,y to gdb in fme

I have JSON file with x,y field. I wonder how to transform geoemtry to gdb? Example of json: [ { "OBJECTID": "1", "x": "15", "y": "21" }, { "OBJECTID": "2", "x": "16", ...
0
votes
1answer
73 views

Getting Problem While Running Spatial ETL Tool

I have Created a spatial ETL tool to do small operations like adding an ID, updating different fields, etc. While running it from the Edit Session of Spatial ETL it runs well and good. ![enter image ...
1
vote
0answers
82 views

Spatial ETL or some other tools?

and, first of all, sorry for my mistakes, my English is not so good. I need to read geographic data from an ORACLE spatial database in Gauss Boaga SRS, convert them in WSG84 (EPSG 32632), e put them ...
1
vote
1answer
81 views

FME: how to extract the coordinate of the North West corner

In an FME translation from a polygon geodatabase feature class to a DGN I am trying to place a label in the top left corner of a box. I have tried using CoordinateExtractor to find the coordinates of ...
1
vote
0answers
110 views

Geokettle transformation for FileGDB to SHP

I want to transform FileGDB layer to Shapefile on Geokettle. Firstly i added OGR Input and than i added a Shapefile Output. And i entered parameters shown on the screenshot but i got errors for ...
1
vote
1answer
310 views

tools and ETLs for migrating data benchmarking - from shapefile to SQL SERVER

i need to migrate my shapefiles to my database SQL SERVER, and i don't know what's the best tool or ETLs to choose, i already tried FME Desktop and i succeded to load the shapefiles on my db, but ...
1
vote
1answer
193 views

Experiences with ArcGIS Data Interoperability

In order to import/extract data from tons of DWG files, I'd like to know experiences with ArcGIS Data Interoperability, and its strong points versus FME or GeoKettle. Thank you very much.
9
votes
2answers
617 views

Migration from ArcSDE (SQL Server) to PostGIS (PostgreSQL)

We've got all the geospatial information of our company within an ArcSDE Database (over SQL Server): points (locations of the antennas), lines (elevation, rivers), polygons (protected areas, ...
3
votes
1answer
565 views

Is Data Interoperability Extension for ArcGIS Server 10 required to extract data in .dgn format?

I am trying to create a Geoprocessing Task in my .mxd to in order to extract data to .SHP and .DGN formats which will be utilized in a data extraction tool for a web application. Right now, there is ...
6
votes
4answers
3k views

Ways to transform from DWG/DXF to GIS (Experiences are welcome)

I've got tons of DWG/DXF files with information (in several layers) dealing with: Contour lines and elevation (lines) positions of antennas (points) protection areas (polygons) administrative ...
8
votes
4answers
2k views

Is there any safe fme alternatives?

Just wondering if there is any open source solution which comes close to safe FME? I would like to integrate it into my workflow, but it´s just another few thousand which my employer has to give out ...
1
vote
2answers
1k views

Using FME to Parse An Attribute Field

I have a table that contains a field with street names. Each street name ends with the street type. Fore example, Washington St, Happy Valley Rd, Redstone Dr. I need to extract the last part of the ...
3
votes
0answers
83 views

Determine the Degree of Data Lossiness when Converting Data

I'm working through some of the ESRI tutorials on Data Interoperability and it briefly mentions the issue of data conversion being a lossy process. Some questions that come to mind are: What is ...
22
votes
5answers
8k views

How to migrate GDB data into PostGIS without ESRI apps?

Can you tell me how I can load geodatabase data into PostGIS without having to install ESRI apps? The solution I found online talked about using ArcGIS to convert GDB to SHP and then importing SHP to ...
17
votes
11answers
4k views

Permanently reorder fields in data (shp, gdb)

If I have a shapefile or geodatabase featureclass that has fields that I want to permanently reorder, is there a tool, script, or utility that will help me quickly accomplish this task? Generally I ...
5
votes
2answers
425 views

Data ETL workflow optimization

I have a legacy workflow that I would like to optimize and automate (at least partially). The current workflow goes like this. I receive a MS Access .mdb file containing a single table. This table ...
4
votes
2answers
553 views

Is it possible to set the output of a spatial etl tool in model builder?

I am using the interoperability extension and building spatial ETL tools, but I can't seem to specify the output location of the ETL tool so it's impossible to use this dynamically. Has anyone ...
12
votes
3answers
912 views

Centralizing shapefile data into database

I've got hundreds of shapefiles from various different GIS projects that I want to start consolidating into a single database platform, currently attempting this with Postgres / PostGIS. Hardly any ...
20
votes
2answers
3k views

Spatial ETL comparisons

I am hoping some of you experts out there can list the pro's and con's of various spatial ETL (extract, transform, load) tools. If you have used these items listed here (or add your own), please ...
9
votes
5answers
1k views

What tools are available for uploading gis data to a database?

I would like a nice graphical tool that allows me to take standard gis data such as shp files and kml files and upload them to a database such as PostGIS, MySql or Oracle. Are there any such tools? ...