Questions tagged [hadoop]

a software library which provides a framework for the distributed processing of large data sets

Filter by
Sorted by
Tagged with
1
vote
0answers
36 views

Defining coordinate system for finding distance in meters [duplicate]

What should I do to find the distance between two very far points? p1 = "POINT(6.2 61.1)" p2 = "POINT(6.1 61.0)" select ST_Distance( ST_Transform(ST_GeomFromWKT('$p1'), 'EPSG:4326', '$epsg'), ...
1
vote
0answers
117 views

How can I limit a Hive spatial binning query to a specific map extent?

I'm trying to do a HQL query based off a map extent. I cant get this to work, what am I doing wrong? I'm using the taxi_demo in the ESRI example. SELECT ST_Bin(0.001, ST_Point(dropoff_longitude,...
1
vote
1answer
442 views

Unable to retrieve date columns in hive

I am finding difficulty when it comes to retrieving date values in hive. I am using esri git hub tools for hadoop and my final objective is to display these columns in arcmap. My query is > ...
1
vote
2answers
387 views

Json to features not working while performing ST_Buffer

My objective is to create a buffer of 1000 m for enode. I used the following query. CREATE external table enodebuffer (shape binary); INSERT OVERWRITE TABLE enodebuffer SELECT ST_Buffer(...
2
votes
2answers
148 views

ArcMap Spatial Join Tool Equivalent In Hadoop

Does anyone know the equivalent of the spatial join tool in ArcMap that can be used in Hadoop? I am trying to join point and polygon data in Hadoop and create a new point files that adds the ...
2
votes
1answer
759 views

Read GeoTiff from memory in GDAL

Is it possible with the GDAL library to read an image (e.g. GeoTiff) from a memory stream, like stdin instead of a defined location on the local disk? It would be useful to read data in streaming ...
2
votes
1answer
418 views

Hive GIS ST_GeodesicLengthWGS84 not returning expected distance

I am trying to find the distance between two points (in meters and not degrees) using GIS Tools for Hadoop by ESRI. The ST_Length provides distance in degrees and hence I used the ...
2
votes
0answers
400 views

Using a file .shp with ESRI Geo Tools for Hadoop

I've a file .shp that I would like to load into a TABLE using HIVE with ESRI Geo Tool for Hadoop. These tools read JSON files and I've tried to convert my file into a .json format using GDAL Library ...
3
votes
0answers
418 views

Doing spatial regression using big data when Spatial weight matrix is too large for R?

I am currently doing an analysis on a quite huge data set - 250,000 polygons. I have figured out the general Moran's I for a linear model, but when I was trying to do a spatial lag or spatial error ...
5
votes
1answer
1k views

GIS Tools for Hadoop for QGIS

I am wondering if something like this: http://esri.github.io/gis-tools-for-hadoop/ exists but for QGIS. Or if these tools be adapted for QGIS.
1
vote
1answer
429 views

How can I limit a spatial binning query to a specific bounding box?

I am using Esri's GIS tools for Hadoop but I think the query is pretty standard stuff. The SQL/HQL below is from the Esri tutorial found here https://github.com/Esri/gis-tools-for-hadoop/wiki/...
1
vote
1answer
575 views

How to use hadoop tools in ArcMap 10.3?

I have downloaded hadoop tools for ArcMap and installed. In the ArcToolboxe window the hadoop tools are displayed. In the hadoop toolbox the "Copy from HDFS" tool is asking for an HDFS server hostname,...
0
votes
1answer
274 views

Reprojecting a Geometry in Hadoop GIS?

I am using ESRI's spatial framework for Hadoop, in order to add spatial support to Hive. One scenario that I find very often, is to have layers in different CRS, which I want to relate in the same ...
1
vote
0answers
460 views

Error using ST_Geometry Aggregate Function for Hive

I am using the ESRI framework that extends the Hive syntax to support spatial types and operations. In particular, I am trying to use an aggregated geometry function, announced in this blog post in ...
4
votes
2answers
4k views

How to load geographic data into Hadoop (Hive) and then to be able to call spatial functions on them?

I need to load some geographic data into Hadoop (Hive), and then, to be able to call some spatial functions on them using Hive. My input data format is ESRI shapefiles (but could be another format, I ...
4
votes
1answer
700 views

Query to Dissolve Nearby Polygons on Hive

I am using the ESRI spatial framework for Hadoop, that extends Hive to use spatial types and operations. My objective is to translate a set of simple queries on PostGIS into Hadoop, in order to ...
1
vote
2answers
2k views

How to process GeoJSON data and create hive table for spatial analysis

I am using the ESRI-GIS tool for hadoop for analyzing json data generated through ESRI products like ArcGIS. But I wanted to analyze spatial data from a PostGIS table for which I made geojson ...
2
votes
1answer
814 views

Create table with Geometry Column in hadoop Hive

Is there a way to add a geometry column in hadoop? Please give me some getting-started tutorial for geoprocessing in hadoop. Like, I have a database which have point values and if I take a random ...
1
vote
2answers
1k views

Load .shp file in Hive(Hadoop)

I need to load .shp files in Hive more precisely in HortonWorks sandbox through Beeswax, can anyone provide example of Hive commands or steps for Beeswax ?
2
votes
1answer
906 views

Integrate QGIS into Hadoop cloud is it possible?

It might be very basic question. Can I integrate QGIS +Hadoop cloud? Currently I am going through similar question and few research articles & researching on my side. In upcoming ArcGIS 10.2 ...