Questions tagged [spatial-etl]

ETL (extract, transform, load)

Filter by
Sorted by
Tagged with
0
votes
0answers
21 views

How to use an MapServer exposed via ArcGIS REST API as a data source in Data Integration Extension ETL tool

I am trying to use the SpatialETL tool in ESRIs Data Integration Extension to cut out rasters from a map service exposed via a REST URL on the following format http://utility.arcgis.com/usrsvcs/...
1
vote
2answers
42 views

Merging feature class with field mappings using datum transformation?

I suspect that there is no easier way to do this, other than developing this as a two-step process with a temporary output (which seems somewhat wasteful). If I have to, I'll just create a temporary ...
2
votes
1answer
83 views

FME and WebDAV resources

FME is capable of reading and writing from and to a broad variety of data sources and formats, but is it somehow possible to read/write from/to a WebDAV resource with FME? A cloud storage solution ...
5
votes
3answers
706 views

How to create autoincrementing primary key with dynamic writer in FME

I'm writing 3 shapefiles to an MSSQL Spatial database with FME. I'm using a writer with dynamic settings to simplify future updates of the input files. In order to create a spatial index with the ...
4
votes
1answer
255 views

FME Error when writing to relationship class in ArcSDE Geodatabase writer type

I'm working in the FME workbench through ESRI Data Interoperability extension (ArcGIS 10.4.1). I'm writing to an SDE geodatabase with relationship classes established. When attempting to setup the ...
2
votes
1answer
88 views

Transforming from BOX2DF to BOX

I am using some legacy code which requires my data in PostgreSQL box type e.g. this format (37357,50073),(34242,357). However, I am using PostGIS with box2df i.e. I get: BOX2DF(588893 4515997, 600342 ...
2
votes
1answer
151 views

How can I get GeoKettle (or any other Java based ETL) to run on MacOS Sierra? [closed]

Has anyone managed to get GeoKettle or Spatial extension for Talend running on MacOS Sierra? If so, how did you do it? These packages have not been updated since 2015 and Apple has more or less ...
1
vote
1answer
303 views

Execute a batch process of a spatial tool within an ArcGIS Toolbox

I have created a Data Interoperability Spatial ETL tool. I do have a Data Interoperability license. I want to create a nightly batch process to run this tool. As suggested, I have created a python ...
5
votes
1answer
709 views

Is GeoKettle still under development? [closed]

GeoKettle (http://www.spatialytics.org/projects/geokettle/) is (or was?) a very promising approach to spatial ETL with an intuitive graphical process design, at least introduced an open source ...
1
vote
0answers
443 views

Can QGIS do automated spatial ETL? [closed]

Can QGIS do automated spatial ETL? ... especially the automated point I'm aware of tools like FME, Talend, etc. but price is a concern, so I'm looking for FOSS alternatives that provide spatial ETL ...
3
votes
2answers
79 views

Simplifying a feature class to feature class ETL using multiple input feature classes with varied schemas

I'm wondering if anyone can help me brainstorm how to simplify this ETL process? The way I have it written, it just feels very repetitive, but I can't think of a way to avoid the repetition. I'll ...
1
vote
1answer
261 views

Spatial ETL for MutliLineString [closed]

I'm pretty new to Spatial ETL. In accordance with this question I have experience the geokettle v3 but unfortunately i'm having a several problems working with it. There is some issues that aren't ...
1
vote
0answers
239 views

Migrating ArcSDE data to Oracle Spatial?

We've got all the geospatial information of our company within an ArcSDE Database (over oracle Server): points lines polygons We consume these data with ArcGIS Desktop and with ArcGIS Server. We ...
2
votes
1answer
583 views

How to print log from FME when run from python script?

I created a Spatial ETL ToolBox in ArcCatalog. When I run the tool from ArcCatalog I see log massages. But when I run this tool from a python script, the logs do not print to the python console. ...
1
vote
0answers
135 views

ArcGIS - Spatial ETL Tool - Checking fields in input shapefile

How to check if the input file fields have the expected name and type? Which transformer will be useful to validate names and types of attributes of reader. edit: I have a shapefile that transforms ...
0
votes
2answers
846 views

Spatial ETL Tools won't run “AttributeError: 'module' object has no attribute, etc.”

I have a python script that runs 5 Spatial ETL tools that I wish to run as a scheduled task. Each of the tools will run successfully from ArcCatalog and also from the ArcCatalog Command line. If I ...
2
votes
1answer
617 views

How to transform JSON with field x,y to GDB in FME

I have JSON file with x,y field. I wonder how to transform geometry to GDB? Example of JSON: [ { "OBJECTID": "1", "x": "15", "y": "21" }, { "OBJECTID": "2", "x": "16", "y"...
1
vote
2answers
994 views

“ERROR 000819: Tool is not assigned” While Running Spatial ETL Tool?

I have Created a spatial ETL tool to do small operations like adding an ID, updating different fields, etc. While running it from the Edit Session of Spatial ETL it runs well and good. http://help....
1
vote
0answers
710 views

Seeking Spatial ETL or some other tools? [closed]

I need to read geographic data from an ORACLE spatial database in Gauss Boaga SRS, convert them in WSG84 (EPSG 32632), e put them in another ORACLE spatial data base. I've tried to use GeoKettle 2.5 ...
1
vote
1answer
692 views

FME: how to extract the coordinate of the North West corner

In an FME translation from a polygon geodatabase feature class to a DGN I am trying to place a label in the top left corner of a box. I have tried using CoordinateExtractor to find the coordinates of ...
1
vote
0answers
506 views

Geokettle transformation for FileGDB to SHP

I want to transform FileGDB layer to Shapefile on Geokettle. Firstly i added OGR Input and than i added a Shapefile Output. And i entered parameters shown on the screenshot but i got errors for ...
1
vote
1answer
1k views

tools and ETLs for migrating data benchmarking - from shapefile to SQL SERVER

i need to migrate my shapefiles to my database SQL SERVER, and i don't know what's the best tool or ETLs to choose, i already tried FME Desktop and i succeded to load the shapefiles on my db, but ...
13
votes
2answers
2k views

Migration from ArcSDE (SQL Server) to PostGIS (PostgreSQL)

We've got all the geospatial information of our company within an ArcSDE Database (over SQL Server): points (locations of the antennas), lines (elevation, rivers), polygons (protected areas, ...
3
votes
1answer
954 views

Is Data Interoperability Extension for ArcGIS Server required to extract data in .dgn format?

I am trying to create a Geoprocessing Task in my .mxd to in order to extract data to .SHP and .DGN formats which will be utilized in a data extraction tool for a web application. Right now, there is ...
10
votes
4answers
9k views

Transforming from DWG/DXF to GIS?

I've got tons of DWG/DXF files with information (in several layers) dealing with: Contour lines and elevation (lines) positions of antennas (points) protection areas (polygons) administrative ...
9
votes
0answers
3k views

Open source alternative to FME from Safe Software for Spatial ETL? [duplicate]

Just wondering if there is any open source solution which comes close to safe FME? I would like to integrate it into my workflow, but it´s just another few thousand which my employer has to give out ...
1
vote
2answers
3k views

Using FME to Parse An Attribute Field

I have a table that contains a field with street names. Each street name ends with the street type. Fore example, Washington St, Happy Valley Rd, Redstone Dr. I need to extract the last part of the ...
3
votes
0answers
111 views

Determine the Degree of Data Lossiness when Converting Data

I'm working through some of the ESRI tutorials on Data Interoperability and it briefly mentions the issue of data conversion being a lossy process. Some questions that come to mind are: What is ...
39
votes
6answers
20k views

Migrating geodatabase data into PostGIS without Esri apps?

Can you tell me how I can load geodatabase data into PostGIS without having to install Esri apps? The solution I found online talked about using ArcGIS to convert GDB to SHP and then importing SHP ...
24
votes
14answers
9k views

Permanently reorder fields in data (shp, gdb)

If I have a shapefile or geodatabase featureclass that has fields that I want to permanently reorder, is there a tool, script, or utility that will help me quickly accomplish this task? Generally I ...
5
votes
2answers
578 views

Data ETL workflow optimization

I have a legacy workflow that I would like to optimize and automate (at least partially). The current workflow goes like this. I receive a MS Access .mdb file containing a single table. This table ...
4
votes
2answers
965 views

Setting output of spatial ETL tool in ModelBuilder?

I am using the data interoperability extension and building spatial ETL tools, but I can't seem to specify the output location of the ETL tool so it's impossible to use this dynamically. Has anyone ...
13
votes
3answers
1k views

Centralizing shapefile data into database

I've got hundreds of shapefiles from various different GIS projects that I want to start consolidating into a single database platform, currently attempting this with Postgres / PostGIS. Hardly any ...
33
votes
10answers
16k views

Seeking options for Spatial ETL (Extract, Transform, Load)?

I am interested in the pros and cons of various spatial ETL (extract, transform, load) tools. If you have used the items listed here (or add your own), I seek your opinions and experiences. In ...
11
votes
5answers
3k views

Seeking tools for uploading GIS data to database?

I would like a nice graphical tool that allows me to take standard gis data such as shp files and kml files and upload them to a database such as PostGIS, MySql or Oracle. Are there any such tools?