Questions tagged [amazon-s3]

Amazon S3 (Simple Storage Service) is an online file storage web service offered by Amazon Web Services.

Filter by
Sorted by
Tagged with
15
votes
4answers
6k views

How to efficiently access files with GDAL from an S3 bucket using VSIS3?

So, GDAL has recently added a new feature that allows random reading of S3 bucket files. I am looking to crop GDAL images from multiple tiles of an image without having to download the whole file. I'...
11
votes
1answer
2k views

Geoserver with Amazon s3 bucket

I have Apache running Geoserver on my virtual instance, and I am wondering whether the Geoserver data directory can point to an Amazon S3 bucket. Is this possible? How does this affect performance? ...
10
votes
3answers
1k views

Carrying out atmospheric correction on Sentinel-2 data from Amazon Web Services?

I'm wondering what the best method is for correcting Sentinel-2 images downloaded in JP2 format (from Amazon Web Services - AWS) to BOA reflectance? As the files downloaded from the sentinel scihub in ...
6
votes
1answer
540 views

Should i use jp2 or cloud optimized geotiffs to efficiently access small windows from Rasters on S3

I am building a system where we have a lot of large rasters (Sentinel-2 bands) stored in S3. A lot of this data is stored in our own buckets so we can store whatever format we find most usable. I ...
5
votes
2answers
6k views

What is the best way to host mbtiles?

What is/are the best way(s) to host mbtiles? I have tried: hosting on my own server with tileserver.php: this works and is very straighforward and simple to set up, but doesn't seem to be super fast ...
4
votes
0answers
231 views

Disable readdir on open in gdal_translate when using /vsicurl/

I'm using /vsicurl/ file handler to read Landsat 8 data out of S3. Following GDAL documentation "to minimize the total number of HTTP requests outside of the target GeoTIFF file" I set ...
2
votes
1answer
642 views

Is it possible to serve vector tiles directly from S3?

I have seen that it is possible to use S3 as a storage backend for vector tile servers such as Tegola. These work by fetching the tile from S3, then serving it through an application server. Is there ...
2
votes
1answer
172 views

Is it possible to store data on Amazon S3 for use in OpenGeo Suite?

We've got about 500GB of geospatial data we'd like to "web-enable" to various degrees and OpenGeo Suite seems like a good route to go down given our circumstances. We can sort out a server (probably ...
2
votes
1answer
522 views

Import point data from amazon s3 into QGIS

I'm working with spatial/temporal data, stored in s3 (AWS). The data is in the format: ID, Date, Lat, Lon 23424 2017-02-03T23:15:15Z 23.434 -5.2343 23424 2017-02-03T23:20:...
2
votes
0answers
416 views

How to access Landsat bucket from Amazon?

I tried to access amazon Landsat S3 bucket with the following python code import boto import boto.s3.connection from boto.s3.connection import S3Connection access_key = <userid> secret_key = &...
1
vote
2answers
1k views

How to read Landsat images from Amazon S3 using Python?

I would like to read and process Landsat images from Amazon S3 using Python
1
vote
1answer
274 views

Syncing private S3 data with CartoDB?

I've been using the new Synced Table feature of CartoDB, and it's working great. But some of the data I want to sync with is not public data. The data provider keeps it on S3, but requires ...
1
vote
0answers
22 views

Unable to download Sentinal file from S3 [duplicate]

I trying below command to download file gdal_translate --config CPL_TMPDIR temp -projwin_srs "EPSG:4326" -projwin 75.576740 31.138820 75.578092 31.137444 /vsicurl/http://sentinel-s2-l1c.s3-website....
1
vote
1answer
265 views

Clipping/cropping/masking a raster tile layer in Mapbox GL JS

I'm loading Landsat tiles into a Mapbox GL JS map via an AWS S3 tile server, and this is working OK, but what I'd really like to do is clip the tile layer to a GeoJSON polygon which is loaded in ...
1
vote
0answers
153 views

How can I create a RasterLayer object layers from a list of files stored as data frame?

I am trying to load raster files stored in AWS s3 bucket and I've managed to read them as data frame. How can I change them to rasterlayer objects? library(aws.3) library(raster) library(rgdal) #...
1
vote
0answers
236 views

Process Landsat8 data in AWS S3 from EC2 instance

I'm wondering what is the best way of processing huge amounts of Landsat8 images stored in the AWS S3 buckets from an Ec2 instance located in the same availability zone. Should I download the scenes ...
1
vote
0answers
92 views

Import postgis layer from S3 link

I have a postgis layer (layer.sql), which I am trying to add to my postgres database (mydatabase). The postgis layer is stored on S3 (https://s3.us.../layer.sql). I can add the layer to my database ...
1
vote
1answer
115 views

Free software to publish tiles on Amazon S3?

Does anyone know of free software that would allow me to publish tiles on Amazon S3? I know of Arc2Earth, but it is not free.
1
vote
0answers
2k views

Access-Control-Allow-Origin problem when loading json file from Amazon S3 to display in OpenLayers

This is my code for displaying geojson in OpenLayers, where "geourl" is directed to a json file in Amazon S3. geojson_layer = new OpenLayers.Layer.Vector("GeoJSON", { strategies: [new OpenLayers....
0
votes
2answers
516 views

How to download Sentinel2 L1C using AWS Python SDK (boto3)

The permissions for Sentinel2 L1C changed today https://www.sentinel-hub.com/faq/how-will-access-permission-changes-aws-bucket-affect-users-accessing-data-directly-non-sentinel# How can I send a '...
0
votes
1answer
1k views

How to import images bucket from AWS S3 using python

How to import images bucket from AWS s3 using python without declaring LOCAL_PATH, i want total bucket images in python environment in array format, from one week on words i am facing this issue, ...
0
votes
0answers
18 views

Difference between S3GeoTiffReader and GeoTiffReader?

What's the difference between S3GeoTiffReader and GeoTiffReader provided by Geotools library? I need to process a GeoTiff image retrieved from AWS S3 bucket.
0
votes
0answers
23 views

Generating my own tiles from OSM, TileMaker, mbutils and amazon EC2 / spot [closed]

I'd like to generate my own tiles, covering the whole planet, to use with mapbox gl js library. I checked a lot of documentation, i'm currently at this point: I downloaded OSM data (.osm.pbf) I read ...
0
votes
1answer
34 views

How to download tile from Amazon’s Sentinel-2 service

How do I access Sentinel-2 imagery via Amazon? I'm new to GIS and have been relying on USGS earth explorer and EO Browser but would now like to access satellite imagery with higher resolution. I ...
0
votes
0answers
134 views

Write feature collection to S3

Is there a way to write a feature collection from Python memory to an S3 bucket (as Esri Shapefile, zipped Shapefile or something else) without writing it first to disk? I tried writing to a ...
0
votes
0answers
195 views

Sentinel-1 GRD and Sentinel-2 L1C on AWS bucket policy

Recently I started to work with Sentinel-1 data hosted on AWS S3 bucket 'sentinel-s1-l1c'. The bucket is requester pays and requires AWS signature version 4. I need to access the files via HTTP GET ...