ETL (extract, transform, load)

learn more… | top users | synonyms

1
vote
1answer
58 views

How to print log from FME when run from python script?

I created a Spatial ETL ToolBox in ArcCatalog. When I run the tool from ArcCatalog I see log massages. But when I run this tool from a python script, the logs do not print to the python console. ...
0
votes
0answers
23 views

Data migration through ETL Tool from file to personal geodatabase with existing geometric network and cardinality rule?

I want to perform data migration through ETL tool from file geodatabase to personal geodatabase with existing geometric network and cardinality rule. Please describe how to migrate?
0
votes
0answers
30 views

ArcGIS - Spatial ETL Tool - Checking fields in input shapefile

How to check if the input file fields have the expected name and type? Which transformer will be useful to validate names and types of attributes of reader. edit: I have a shapefile that transforms ...
0
votes
1answer
105 views

Spatial ETL Tools won't run “AttributeError: 'module' object has no attribute, etc.”

I have a python script that runs 5 Spatial ETL tools that I wish to run as a scheduled task. Each of the tools will run successfully from ArcCatalog and also from the ArcCatalog Command line. If I ...
2
votes
1answer
57 views

How to transform JSON with field x,y to gdb in fme

I have JSON file with x,y field. I wonder how to transform geoemtry to gdb? Example of json: [ { "OBJECTID": "1", "x": "15", "y": "21" }, { "OBJECTID": "2", "x": "16", ...
0
votes
1answer
98 views

Getting Problem While Running Spatial ETL Tool

I have Created a spatial ETL tool to do small operations like adding an ID, updating different fields, etc. While running it from the Edit Session of Spatial ETL it runs well and good. ![enter image ...
1
vote
0answers
105 views

Spatial ETL or some other tools?

and, first of all, sorry for my mistakes, my English is not so good. I need to read geographic data from an ORACLE spatial database in Gauss Boaga SRS, convert them in WSG84 (EPSG 32632), e put them ...
1
vote
1answer
103 views

FME: how to extract the coordinate of the North West corner

In an FME translation from a polygon geodatabase feature class to a DGN I am trying to place a label in the top left corner of a box. I have tried using CoordinateExtractor to find the coordinates of ...
1
vote
0answers
121 views

Geokettle transformation for FileGDB to SHP

I want to transform FileGDB layer to Shapefile on Geokettle. Firstly i added OGR Input and than i added a Shapefile Output. And i entered parameters shown on the screenshot but i got errors for ...
1
vote
1answer
364 views

tools and ETLs for migrating data benchmarking - from shapefile to SQL SERVER

i need to migrate my shapefiles to my database SQL SERVER, and i don't know what's the best tool or ETLs to choose, i already tried FME Desktop and i succeded to load the shapefiles on my db, but ...
1
vote
1answer
200 views

Experiences with ArcGIS Data Interoperability

In order to import/extract data from tons of DWG files, I'd like to know experiences with ArcGIS Data Interoperability, and its strong points versus FME or GeoKettle. Thank you very much.
9
votes
2answers
662 views

Migration from ArcSDE (SQL Server) to PostGIS (PostgreSQL)

We've got all the geospatial information of our company within an ArcSDE Database (over SQL Server): points (locations of the antennas), lines (elevation, rivers), polygons (protected areas, ...
3
votes
1answer
601 views

Is Data Interoperability Extension for ArcGIS Server 10 required to extract data in .dgn format?

I am trying to create a Geoprocessing Task in my .mxd to in order to extract data to .SHP and .DGN formats which will be utilized in a data extraction tool for a web application. Right now, there is ...
6
votes
4answers
3k views

Ways to transform from DWG/DXF to GIS (Experiences are welcome)

I've got tons of DWG/DXF files with information (in several layers) dealing with: Contour lines and elevation (lines) positions of antennas (points) protection areas (polygons) administrative ...
9
votes
0answers
3k views

Open source alternative to FME from Safe Software for Spatial ETL? [duplicate]

Just wondering if there is any open source solution which comes close to safe FME? I would like to integrate it into my workflow, but it´s just another few thousand which my employer has to give out ...
1
vote
2answers
1k views

Using FME to Parse An Attribute Field

I have a table that contains a field with street names. Each street name ends with the street type. Fore example, Washington St, Happy Valley Rd, Redstone Dr. I need to extract the last part of the ...
3
votes
0answers
86 views

Determine the Degree of Data Lossiness when Converting Data

I'm working through some of the ESRI tutorials on Data Interoperability and it briefly mentions the issue of data conversion being a lossy process. Some questions that come to mind are: What is ...
26
votes
5answers
9k views

How to migrate GDB data into PostGIS without ESRI apps?

Can you tell me how I can load geodatabase data into PostGIS without having to install ESRI apps? The solution I found online talked about using ArcGIS to convert GDB to SHP and then importing SHP to ...
17
votes
11answers
4k views

Permanently reorder fields in data (shp, gdb)

If I have a shapefile or geodatabase featureclass that has fields that I want to permanently reorder, is there a tool, script, or utility that will help me quickly accomplish this task? Generally I ...
5
votes
2answers
441 views

Data ETL workflow optimization

I have a legacy workflow that I would like to optimize and automate (at least partially). The current workflow goes like this. I receive a MS Access .mdb file containing a single table. This table ...
4
votes
2answers
594 views

Is it possible to set the output of a spatial etl tool in model builder?

I am using the interoperability extension and building spatial ETL tools, but I can't seem to specify the output location of the ETL tool so it's impossible to use this dynamically. Has anyone ...
12
votes
3answers
922 views

Centralizing shapefile data into database

I've got hundreds of shapefiles from various different GIS projects that I want to start consolidating into a single database platform, currently attempting this with Postgres / PostGIS. Hardly any ...
20
votes
6answers
4k views

Seeking options for Spatial ETL (Extract, Transform, Load)?

I am interested in the pro's and con's of various spatial ETL (extract, transform, load) tools. If you have used the items listed here (or add your own), please share your opinions and experiences. ...
9
votes
5answers
1k views

What tools are available for uploading gis data to a database?

I would like a nice graphical tool that allows me to take standard gis data such as shp files and kml files and upload them to a database such as PostGIS, MySql or Oracle. Are there any such tools? ...