Questions tagged [amazon-web-services]

Amazon Web Services (AWS), is a collection of cloud computing services that make up the on-demand computing platform offered by Amazon.com.

Filter by
Sorted by
Tagged with
0 votes
0 answers
32 views

QGIS PostgreSQL Amazon RDS AWS - id issue

This is a novice question. I created a database using Amazon RDS AWS. Then I connected it to my PostgreSQL. I am planning to utilize this for multi-user access to digitize blighted areas through QGIS. ...
  • 119
1 vote
0 answers
126 views

GeoServer j_spring_security_check on Login

I have a GeoServer container that I am trying to push up to the AWS Cloud Environment. Things work as usual (default settings ) for my 19.2.2 version of GeoServer on my localhost. When I push the ...
  • 143
0 votes
1 answer
54 views

Hosting Multiple GeoServer instances on the Same DNS

I have 2 instances of GeoServer that I am trying to run in the AWS Cloud environment on the same DNS. I am using Tomcat. https://testhost.com/geoserver https://testhost.com/geoserver-archive The load ...
  • 143
0 votes
0 answers
38 views

Public AWS URL to Landsat-8 images - error 404

I'm not the only one having trouble downloading Landsat images from aws server using a URL like this: https://s3-us-west-2.amazonaws.com/landsat-pds/L8/017/008/LC80170082015211LGN00/index.html As in ...
0 votes
0 answers
40 views

WFS for dataset in S3 using QGIS Server

I have some data in FlatGeobuf format sitting on an AWS S3 bucket. I would like to provide some Web Feature Services (WFS) for this dataset using QGIS-Server. I have successfully deployed QGIS-Server ...
0 votes
1 answer
101 views

Connecting ArcGIS Online to PostgreSQL on Amazon Web Server

I have some key data sets stored on PostgreSQL on an Amazon Web Server. Is there any way, (direct or work around), that I can connect to this data in ArcGIS Online. I can connect to it with ArcGIS Pro,...
0 votes
0 answers
61 views

Registering raster layers in Amazon RDS PostgreSQL using enable_out_db parameter

I have an AWS RDS PostgreSQL instance (v.11) that I'm currently storing vector data in. I also have a lot of raster layers in AWS S3 that are COG geotiffs. I'd like to register them in the database to ...
0 votes
0 answers
78 views

Connecting to RDS PostgreSQL with QGIS with SSH?

I’m still kind of learning and this is new to me so forgive me if I’m using the wrong terminology or wrong tools. I’m trying to connect a local client (QGIS) to a PostgreSQL database hosted on an RDS ...
  • 45
0 votes
0 answers
25 views

Incidence angle meta-data for Sentinel 1 GRD on AWS

I have seen how incidence angles can be obtained for Sentinel 1 sigma-0 backscatter when processing from the SLC product with SNAP. However, I want to use the pre-processed GRD product. I couldn't ...
0 votes
0 answers
26 views

Error 500: Unable to getParts for Multipart item when adding content to Portal that has an AWS Data Store

I am using ArcGIS API for Python to upload content to Portal using the gis.content.add and then publish methodology (this process needs to be automated). It works great with small/regular sized ...
1 vote
1 answer
638 views

Error trying to open NetCDF file with xarray from s3 bucket

I'm trying to open a .nc file from an S3 bucket using xarray, but I'm getting an error. Here's the method I'm using: import xarray as xr aws_url = 's3://nasanex/NEX-GDDP/BCSD/rcp85/day/atmos/tasmax/...
  • 488
1 vote
1 answer
116 views

Getting 404 response while fetching Landsat-8 data from AWS S3

I am trying to fetch Landsat-8 satellite data from AWS S3 and for getting details, I am using gdalinfo command: gdalinfo /vsicurl/https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/144/048/...
  • 11
0 votes
1 answer
108 views

Protecting Vector Tile Server Data

I am deploying a Vector Tile Server on AWS with data I don't want to make publicly available and there are two main elements I want to cover regarding the security of the data The tile server needs ...
1 vote
1 answer
217 views

Create STAC catalog file for my s3 bucket

I have s3 private bucket which contains .tif files. Now, I need to create STAC file like the following: https://earth-search.aws.element84.com/v0 https://earthengine-stac.storage.googleapis.com/...
0 votes
0 answers
136 views

Does QGIS support AWS Redshift connection?

I am planning to connect AWS Redshift using QGIS for work purposes. However, I am not sure whether I can connect or not.
0 votes
1 answer
40 views

Finding libraries for GRASS Installation Linux

I am installing GRASS on Linux. I have gotten as far as running Make in these instructions: https://grass.osgeo.org/grass78/binary/linux/snapshot/INSTALL I get this for multiple libraries: error while ...
0 votes
1 answer
48 views

Installing GRASS on Linux

I am installing GRASS on Linux using source code and the ./configure file to create a standalone python script. I have been following instructions and installing relevant code like proj4 and GDAL and ...
0 votes
0 answers
44 views

How to properly store and analyze spatial data in AWS Redshift

There is an AWS Redshift cluster as well as AWS Aurora. We want to create a unified data warehouse, including for spatial data. Many of the existing processes established in Aurora cannot be performed ...
  • 176
1 vote
1 answer
174 views

How to get Copernicus DEM GeoTIFFs for a bounding box using Python

Background According to AWS's Copernicus Digital Elevation Model page, The Copernicus DEM is a Digital Surface Model (DSM) which represents the surface of the Earth including buildings, ...
  • 262
0 votes
1 answer
171 views

How to avoid (occasional) 404 errors when trying to access Sentinel-2 images using pystac-client

I use pystac-client to access some sentinel images. In Google Colab, I install pystac-client and rasterio by: %%shell pip install pystac-client pip install rasterio Import both modules: from ...
  • 262
0 votes
1 answer
78 views

AWS GeoServer not responding

I made a WMS host with AWS. The WMS work with link below localhost:8080/geoserver/OSM/wms? But I'd like to reach it out of the network with this link and QGIS: http://ec2-xxx-xxx-xxx-xxx.us-east-2....
  • 73
1 vote
0 answers
107 views

QGIS Server Not Rendering VRT Layer that is accessing COGS on S3

I have deployed a QGIS server following steps in the user manual on an AWS EC-2 instance. https://docs.qgis.org/3.16/en/docs/server_manual/containerized_deployment.html#docker-stacks I am serving ...
  • 1,527
2 votes
1 answer
196 views

Intake-STAC: KeyError: 'open_stac_item_collection'

I downloaded the AWS Earth search notebook from the intake-stac examples and whithout changing anything. Just run the cells... But I've got everytime the error: KeyError: 'open_stac_item_collection' ...
5 votes
1 answer
642 views

Trouble writing .tif from memory directly into S3 Bucket

I've used question on the topic as initial help and structured my code after it. I'm warping a raster file using these kwargs rast = gdal.Open(/vsicurl/raster_url) wkt = rast.GetProjection() outbounds ...
  • 488
0 votes
1 answer
234 views

Licensing ArcGIS Enterprise when scaling in cloud environment [closed]

Esri's ArcGIS Enterprise licenses are for use on machines with "up to 4 cores". I understand that in cloud environments (such as AWS) that available machines have an equivalent number of ...
  • 11
1 vote
0 answers
146 views

DBSCAN with huge number of points

We have a dataset of approximately 30 million new points per month (latitude, longitude, and a measurement associated with that point). So far, we have applied DBSCAN to generate a monthly map such ...
  • 11
2 votes
1 answer
221 views

Synchronizing on-prem PostgreSQL raster database with AWS RDS

I have a folder of rasters that updates daily that I load into a PostgreSQL database using the raster2pgsql command line tool. I want to make this database outward facing so that I can connect to it. ...
  • 488
3 votes
2 answers
3k views

HTTP request -to- AWS Lambda Python function -to- AGOL

I want to make an HTTP GET request to AGOL, but I want to route the request through a Python function. Since I can't host the Python function on AGOL (more info here), I'd like to use AWS-Lambda ...
  • 878
2 votes
0 answers
85 views

Unable to list Sentinel l1c file using AWS CLI

Following Setting for AWS CLI using AWS configure AWS Access Key ID : ********** AWS Secret Access Key : ******** Default region name : eu-central-1 which I get from IAM user After setup I try to ...
1 vote
0 answers
116 views

Unable to execute QGIS algorithm while taking Input raster directly from AWS S3 account

I have a raster file (.TIF) in my AWS S3 account. I am using GDAL to open that .TIF file and to save the reprojected .TIF file to my local computer using QGIS GDAL 'Warp (reproject)' algorithm as ...
  • 729
0 votes
0 answers
101 views

Why is spatialite query taking so long (only) on first execution?

I have an AWS lambda function deployed with a spatialite table. When queried, a point lookup is done on the table to find the locations in the table containing the point. The first execution of the ...
1 vote
0 answers
131 views

Publishing PostGIS layer where PostgreSQL in Amazon RDS

I am trying to publish a PostGIS layer in GeoServer from my local machine. PostgreSQL is in AWS RDSs server. I am unable to see any features in layer preview. AWS RDS is SSL-enabled. it is worknig ...
  • 11
5 votes
1 answer
2k views

QGIS Read COG from S3

I am trying to read a Cloud Optimised GeoTiff (COG) from AWS S3. I can successfully run gdalinfo /vsis3/cog-testing/HP_COG.tif And see the details of the file and it says Layout: COG But if I ...
  • 3,170
1 vote
0 answers
6k views

Writing Python list data into CSV file in multiple columns? [closed]

I am trying to write data into csv file from python list. I am using aws lambda for this...... My code fields = ['SnapshotId', 'StartDate'] csvio = io.StringIO() writer = csv.writer(csvio,delimiter=...
1 vote
1 answer
532 views

Spatial queries with PostgreSQL on AWS

I have some data in PostgreSQL which I am exporting to Amazon RDS service. Is it possible to use PostGIS extension in AWS? (And will I need the mandatory geom column or I could run queries with only ...
  • 11
1 vote
1 answer
572 views

How to download tile from Amazon’s Sentinel-2 service

How do I access Sentinel-2 imagery via Amazon? I'm new to GIS and have been relying on USGS earth explorer and EO Browser but would now like to access satellite imagery with higher resolution. I ...
1 vote
0 answers
144 views

Convert a AWS EC2 URL to WMS URL

I have built my tile server on AWS EC2 instance and want to use it as a base map in QGIS. When I try to add it as a WMS layer on QGIS, I get an error saying The server you are trying to connect to ...
1 vote
1 answer
731 views

Build tile server manually with PostgreSQL db on a different server

I have set up my map tile server and have used the following components: Mod_tile osm2pgsql postgres Mapnik open street map carto In my configuration, postgres is on a different server. when I ...
1 vote
0 answers
77 views

Point density from XY table in ArcGIS Pro

I have a large 1.1gb CSV table of points in Lat/Long WGS84 for which I'd like to generate a point density raster. I'm taking the following steps but the process is extremely slow. I welcome any advice ...
  • 621
3 votes
1 answer
271 views

Sentinel 2 Atmospheric Correction Inconsistencies

I'm having some peculiar issues with Sentinel 2 data. I've downloaded two coterminous tiles (one L1C tile from EarthExplorer and one L1C/L2A tile from AWS) taken at the same time and date. I have done ...
1 vote
0 answers
120 views

Load unsafe script error: http vs https

We have an ArcGIS server hosted on Amazon. The maps and layers on that server are used to build a website (i.e. xxxx.com/map. The problem is, that page always shows an error "load unsafe scritps". If ...
0 votes
0 answers
188 views

Moving GIS Data to AWS?

I am an ArcGIS Desktop user and a layman to cloud computing. Our GIS data is currently hosted on a server and recently our IT dept started to look at possibilities to get rid of this server and move ...
  • 11
2 votes
1 answer
1k views

How to generate a correct HTTP response for a pbf within AWS API Gateway?

I am attempting to implement this approach to serving vector tiles from PostGIS using a lambda function and an AWS API Gateway Method: https://www.sparkgeo.com/blog/vector-tile-server-using-postgis. ...
  • 14.5k
1 vote
1 answer
979 views

Download and Browse Sentinel data from AWS

It's been a while since I downloaded or browsed Sentinel data in AWS from http://sentinel-s2-l1c.s3-website.eu-central-1.amazonaws.com/tiles/ But I can not access this website anymore. Is it closed ...
1 vote
1 answer
2k views

Clipping/cropping/masking a raster tile layer in Mapbox GL JS

I'm loading Landsat tiles into a Mapbox GL JS map via an AWS S3 tile server, and this is working OK, but what I'd really like to do is clip the tile layer to a GeoJSON polygon which is loaded in ...
1 vote
1 answer
551 views

Java unsatisfied link error at runtime

I'm getting an unsatisfied link error when running gdal.AllRegister() in my java application running on AWS Lambda. java.lang.UnsatisfiedLinkError: /var/task/lib/libgdaljni.so: libgdal.so: cannot ...
0 votes
1 answer
192 views

Fmask 4.0 on Sentinel data from Sinergise/AWS

I have downloaded Sentinel data from the AWS bucket on S3. How can I place this into the appropriate SAFE folder structure to run the Fmask cloud masking software (https://github.com/GERSL/Fmask)?
1 vote
1 answer
1k views

Making subset of Sentinel-2 with rasterio?

I am looking for a solution to my problem with rasterio. I want to download just a specific part of the image from AWS based on lat lon coordinates. Rasterio offers a great tool (window) although it ...
0 votes
0 answers
68 views

Automating Redshift data dump to a PostgreSQL DB every 12 hours

I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I have a Postgres DB where all my web-mapping data is stored. I want to continuously ...
1 vote
2 answers
2k views

Querying Geospatial data in Athena database, getting rows in range of 5 miles from specified coordinates

I have database table Building with these columns: name, lat, lng How can I get all Buildings in range of 5 miles from specified coordinates, for example these: -84.38653999999998 33.72024 ? ...