ETL (extract, transform, load)

learn more… | top users | synonyms (1)

0
votes
0answers
35 views

Is GeoKettle still under development?

GeoKettle (http://www.spatialytics.org/projects/geokettle/) is (or was?) a very promising approach to spatial ETL with an intuitive graphical process design, at least introduced an open source ...
1
vote
0answers
63 views

Can QGIS do automated spatial ETL? [closed]

Can QGIS do automated spatial ETL? ... especially the automated point I'm aware of tools like FME, Talend, etc. but price is a concern, so I'm looking for FOSS alternatives that provide spatial ETL ...
3
votes
2answers
46 views

Simplifying a feature class to feature class ETL using multiple input feature classes with varied schemas

I'm wondering if anyone can help me brainstorm how to simplify this ETL process? The way I have it written, it just feels very repetitive, but I can't think of a way to avoid the repetition. I'll ...
1
vote
1answer
55 views

Spatial ETL for MutliLineString [closed]

I'm pretty new to Spatial ETL. In accordance with this question I have experience the geokettle v3 but unfortunately i'm having a several problems working with it. There is some issues that aren't ...
0
votes
0answers
37 views

View multiple NEATLINES of a geoPDF using GDAL

I've created a PDF that has two PDF Viewports, the main map and an overview map. When running gdalinfo it only finds a single NEATLINE. Is there a way to list all NEATLINES in the document using ...
1
vote
0answers
101 views

Migrating ArcSDE data to Oracle Spatial?

We've got all the geospatial information of our company within an ArcSDE Database (over oracle Server): points lines polygons We consume these data with ArcGIS Desktop and with ArcGIS Server. ...
1
vote
1answer
243 views

How to print log from FME when run from python script?

I created a Spatial ETL ToolBox in ArcCatalog. When I run the tool from ArcCatalog I see log massages. But when I run this tool from a python script, the logs do not print to the python console. ...
1
vote
0answers
110 views

ArcGIS - Spatial ETL Tool - Checking fields in input shapefile

How to check if the input file fields have the expected name and type? Which transformer will be useful to validate names and types of attributes of reader. edit: I have a shapefile that transforms ...
0
votes
2answers
537 views

Spatial ETL Tools won't run “AttributeError: 'module' object has no attribute, etc.”

I have a python script that runs 5 Spatial ETL tools that I wish to run as a scheduled task. Each of the tools will run successfully from ArcCatalog and also from the ArcCatalog Command line. If I ...
2
votes
1answer
262 views

How to transform JSON with field x,y to gdb in fme

I have JSON file with x,y field. I wonder how to transform geoemtry to gdb? Example of json: [ { "OBJECTID": "1", "x": "15", "y": "21" }, { "OBJECTID": "2", "x": "16", "y"...
1
vote
2answers
528 views

“ERROR 000819: Tool is not assigned” While Running Spatial ETL Tool?

I have Created a spatial ETL tool to do small operations like adding an ID, updating different fields, etc. While running it from the Edit Session of Spatial ETL it runs well and good. Now I want ...
1
vote
0answers
318 views

Spatial ETL or some other tools?

and, first of all, sorry for my mistakes, my English is not so good. I need to read geographic data from an ORACLE spatial database in Gauss Boaga SRS, convert them in WSG84 (EPSG 32632), e put them ...
1
vote
1answer
406 views

FME: how to extract the coordinate of the North West corner

In an FME translation from a polygon geodatabase feature class to a DGN I am trying to place a label in the top left corner of a box. I have tried using CoordinateExtractor to find the coordinates of ...
1
vote
0answers
339 views

Geokettle transformation for FileGDB to SHP

I want to transform FileGDB layer to Shapefile on Geokettle. Firstly i added OGR Input and than i added a Shapefile Output. And i entered parameters shown on the screenshot but i got errors for ...
1
vote
1answer
821 views

tools and ETLs for migrating data benchmarking - from shapefile to SQL SERVER

i need to migrate my shapefiles to my database SQL SERVER, and i don't know what's the best tool or ETLs to choose, i already tried FME Desktop and i succeded to load the shapefiles on my db, but ...
11
votes
2answers
1k views

Migration from ArcSDE (SQL Server) to PostGIS (PostgreSQL)

We've got all the geospatial information of our company within an ArcSDE Database (over SQL Server): points (locations of the antennas), lines (elevation, rivers), polygons (protected areas, ...
3
votes
1answer
769 views

Is Data Interoperability Extension for ArcGIS Server required to extract data in .dgn format?

I am trying to create a Geoprocessing Task in my .mxd to in order to extract data to .SHP and .DGN formats which will be utilized in a data extraction tool for a web application. Right now, there is ...
9
votes
4answers
7k views

Transforming from DWG/DXF to GIS?

I've got tons of DWG/DXF files with information (in several layers) dealing with: Contour lines and elevation (lines) positions of antennas (points) protection areas (polygons) administrative ...
9
votes
0answers
3k views

Open source alternative to FME from Safe Software for Spatial ETL? [duplicate]

Just wondering if there is any open source solution which comes close to safe FME? I would like to integrate it into my workflow, but it´s just another few thousand which my employer has to give out ...
1
vote
2answers
3k views

Using FME to Parse An Attribute Field

I have a table that contains a field with street names. Each street name ends with the street type. Fore example, Washington St, Happy Valley Rd, Redstone Dr. I need to extract the last part of the ...
3
votes
0answers
106 views

Determine the Degree of Data Lossiness when Converting Data

I'm working through some of the ESRI tutorials on Data Interoperability and it briefly mentions the issue of data conversion being a lossy process. Some questions that come to mind are: What is ...
30
votes
6answers
15k views

Migrating geodatabase data into PostGIS without Esri apps?

Can you tell me how I can load geodatabase data into PostGIS without having to install Esri apps? The solution I found online talked about using ArcGIS to convert GDB to SHP and then importing SHP ...
21
votes
12answers
7k views

Permanently reorder fields in data (shp, gdb)

If I have a shapefile or geodatabase featureclass that has fields that I want to permanently reorder, is there a tool, script, or utility that will help me quickly accomplish this task? Generally I ...
6
votes
2answers
529 views

Data ETL workflow optimization

I have a legacy workflow that I would like to optimize and automate (at least partially). The current workflow goes like this. I receive a MS Access .mdb file containing a single table. This table ...
4
votes
2answers
762 views

Setting output of spatial ETL tool in ModelBuilder?

I am using the data interoperability extension and building spatial ETL tools, but I can't seem to specify the output location of the ETL tool so it's impossible to use this dynamically. Has anyone ...
13
votes
3answers
1k views

Centralizing shapefile data into database

I've got hundreds of shapefiles from various different GIS projects that I want to start consolidating into a single database platform, currently attempting this with Postgres / PostGIS. Hardly any ...
28
votes
10answers
9k views

Seeking options for Spatial ETL (Extract, Transform, Load)?

I am interested in the pro's and con's of various spatial ETL (extract, transform, load) tools. If you have used the items listed here (or add your own), please share your opinions and experiences. ...
11
votes
5answers
2k views

What tools are available for uploading gis data to a database?

I would like a nice graphical tool that allows me to take standard gis data such as shp files and kml files and upload them to a database such as PostGIS, MySql or Oracle. Are there any such tools? ...