Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [amazon-s3]

Amazon S3 (Simple Storage Service) is an online file storage web service offered by Amazon Web Services.

0
votes
0answers
54 views

Write feature collection to S3

Is there a way to write a feature collection from Python memory to an S3 bucket (as Esri Shapefile, zipped Shapefile or something else) without writing it first to disk? I tried writing to a ...
0
votes
1answer
151 views

Is it possible to serve vector tiles directly from S3?

I have seen that it is possible to use S3 as a storage backend for vector tile servers such as Tegola. These work by fetching the tile from S3, then serving it through an application server. Is there ...
1
vote
1answer
96 views

Clipping/cropping/masking a raster tile layer in Mapbox GL JS

I'm loading Landsat tiles into a Mapbox GL JS map via an AWS S3 tile server, and this is working OK, but what I'd really like to do is clip the tile layer to a GeoJSON polygon which is loaded in ...
0
votes
0answers
41 views

Consuming Amazon S3 hosted PNGs with quadkey format as tile

I have PNG tiles hosted in an Amazon S3 Bucket. I would like to consume these as a layer into a leaflet map. I have taken this example for reference which converts the quad key to tiles. How would ...
0
votes
2answers
392 views

How to download Sentinel2 L1C using AWS Python SDK (boto3)

The permissions for Sentinel2 L1C changed today https://www.sentinel-hub.com/faq/how-will-access-permission-changes-aws-bucket-affect-users-accessing-data-directly-non-sentinel# How can I send a '...
0
votes
0answers
165 views

Sentinel-1 GRD and Sentinel-2 L1C on AWS bucket policy

Recently I started to work with Sentinel-1 data hosted on AWS S3 bucket 'sentinel-s1-l1c'. The bucket is requester pays and requires AWS signature version 4. I need to access the files via HTTP GET ...
1
vote
0answers
95 views

How can I create a RasterLayer object layers from a list of files stored as data frame?

I am trying to load raster files stored in AWS s3 bucket and I've managed to read them as data frame. How can I change them to rasterlayer objects? library(aws.3) library(raster) library(rgdal) #...
0
votes
0answers
65 views

VRT file in S3 including shapefiles

I have a bunch of shapefiles zipped and stored in S3 bucket. I would like to create virtual format file from those, and also stored in S3. For now I am able to read zipped file from s3 using ogr ...
5
votes
1answer
337 views

Should i use jp2 or cloud optimized geotiffs to efficiently access small windows from Rasters on S3

I am building a system where we have a lot of large rasters (Sentinel-2 bands) stored in S3. A lot of this data is stored in our own buckets so we can store whatever format we find most usable. I ...
0
votes
1answer
1k views

How to import images bucket from AWS S3 using python

How to import images bucket from AWS s3 using python without declaring LOCAL_PATH, i want total bucket images in python environment in array format, from one week on words i am facing this issue, ...
2
votes
1answer
374 views

Import point data from amazon s3 into QGIS

I'm working with spatial/temporal data, stored in s3 (AWS). The data is in the format: ID, Date, Lat, Lon 23424 2017-02-03T23:15:15Z 23.434 -5.2343 23424 2017-02-03T23:20:...
4
votes
0answers
199 views

Disable readdir on open in gdal_translate when using /vsicurl/

I'm using /vsicurl/ file handler to read Landsat 8 data out of S3. Following GDAL documentation "to minimize the total number of HTTP requests outside of the target GeoTIFF file" I set ...
10
votes
3answers
1k views

Carrying out atmospheric correction on Sentinel-2 data from Amazon Web Services?

I'm wondering what the best method is for correcting Sentinel-2 images downloaded in JP2 format (from Amazon Web Services - AWS) to BOA reflectance? As the files downloaded from the sentinel scihub in ...
14
votes
4answers
5k views

How to efficiently access files with GDAL from an S3 bucket using VSIS3?

So, GDAL has recently added a new feature that allows random reading of S3 bucket files. I am looking to crop GDAL images from multiple tiles of an image without having to download the whole file. I'...
1
vote
0answers
225 views

Process Landsat8 data in AWS S3 from EC2 instance

I'm wondering what is the best way of processing huge amounts of Landsat8 images stored in the AWS S3 buckets from an Ec2 instance located in the same availability zone. Should I download the scenes ...
1
vote
0answers
82 views

Import postgis layer from S3 link

I have a postgis layer (layer.sql), which I am trying to add to my postgres database (mydatabase). The postgis layer is stored on S3 (https://s3.us.../layer.sql). I can add the layer to my database ...
2
votes
0answers
403 views

How to access Landsat bucket from Amazon?

I tried to access amazon Landsat S3 bucket with the following python code import boto import boto.s3.connection from boto.s3.connection import S3Connection access_key = <userid> secret_key = &...
1
vote
2answers
941 views

How to read Landsat images from Amazon S3 using Python?

I would like to read and process Landsat images from Amazon S3 using Python
11
votes
1answer
2k views

Geoserver with Amazon s3 bucket

I have Apache running Geoserver on my virtual instance, and I am wondering whether the Geoserver data directory can point to an Amazon S3 bucket. Is this possible? How does this affect performance? ...
1
vote
1answer
108 views

Free software to publish tiles on Amazon S3?

Does anyone know of free software that would allow me to publish tiles on Amazon S3? I know of Arc2Earth, but it is not free.
5
votes
2answers
5k views

What is the best way to host mbtiles?

What is/are the best way(s) to host mbtiles? I have tried: hosting on my own server with tileserver.php: this works and is very straighforward and simple to set up, but doesn't seem to be super fast ...
1
vote
0answers
2k views

Access-Control-Allow-Origin problem when loading json file from Amazon S3 to display in OpenLayers

This is my code for displaying geojson in OpenLayers, where "geourl" is directed to a json file in Amazon S3. geojson_layer = new OpenLayers.Layer.Vector("GeoJSON", { strategies: [new OpenLayers....
1
vote
1answer
270 views

Syncing private S3 data with CartoDB?

I've been using the new Synced Table feature of CartoDB, and it's working great. But some of the data I want to sync with is not public data. The data provider keeps it on S3, but requires ...
2
votes
1answer
167 views

Is it possible to store data on Amazon S3 for use in OpenGeo Suite?

We've got about 500GB of geospatial data we'd like to "web-enable" to various degrees and OpenGeo Suite seems like a good route to go down given our circumstances. We can sort out a server (probably ...