Skip to main content

Questions tagged [amazon-web-services]

Amazon Web Services (AWS), is a collection of cloud computing services that make up the on-demand computing platform offered by Amazon.com.

Filter by
Sorted by
Tagged with
0 votes
0 answers
44 views

Creating a single, large mosaic file in S3 from tiles that cannot fit into memory?

I'm trying to form a (very) large mosaic raster from constituent files in S3, and the amount of data is extremely large; I'm not sure on the actual size, but let's say it's really huge, say over a TB. ...
Doug MacArthur's user avatar
1 vote
2 answers
81 views

What is the correct format to add a custom XYZ tiles {zoom}/{x}/{y}.png) layer in QGIS 3?

I have tiles loaded for a Leaflet map that work fine in Leaflet but I am having difficulty using these tiles with QGIS. They are loaded onto AWS. The psudo url is: https://mytiles.s3.us-east-2....
Cary H's user avatar
  • 996
1 vote
1 answer
53 views

Altering AWS environment custom variable with PyQGIS

I was able to create a script which imports into QGIS .vrt files from a private bucket in Amazon Web Services S3. But I had this one-time task to manually set the environment custom variables ...
Andre Silva's user avatar
  • 10.3k
1 vote
1 answer
46 views

Is there a way to convert a map image layer to a .png/.jpeg file?

I am trying to host a map image layer (ArcGIS map service file) on an Amazon Web Service map. I want to reference this in an Amazon Location Services app that I'm creating for my coworkers. My theory ...
George's user avatar
  • 11
0 votes
0 answers
56 views

Amazon AWS website location

I'm trying to add a layer to my AWS Amplify map to be displayed in an HTML map for others to use. I can't seem to grasp the concept of the 'GetMap' capability that was stated in the AWS documentation-...
George's user avatar
  • 1
0 votes
0 answers
42 views

I am trying deploy GeoServer into AWS ECS Fargate mode. I tried kartoza/geoserver:latest and docker.osgeo.org/geoserver:2.25.x

Official dockerfile: https://docs.geoserver.org/main/en/user/installation/docker.html kartoza docker: https://github.com/kartoza/docker-geoserver Both of them work on localhost. I tried to deploy it ...
jason dev's user avatar
0 votes
0 answers
87 views

GeoServer custom configuration is overidden being overridden by EFS in AWS ECS deployment

We're using Amazon ECS to deploy our custom GeoServer Docker image and have opted to mount an Amazon EFS filesystem for the GeoServer data directory. Within this directory on EFS, we have several data ...
SURESH ANDEM's user avatar
1 vote
0 answers
75 views

How to create a virtual point cloud (VPC) with S3 URLs to read COPC files in QGIS 3.32?

I have been converting LAS files (pdrf 6) to COPC using QGIS 3.32. It then reads well in QGIS but doesn't once uploaded on AWS S3. The bucket is not public, so I have tried to input AWS_ACCESS_KEY_ID ...
Leo's user avatar
  • 701
0 votes
0 answers
192 views

AWS Lambda layer in eu-west-2 containing gdal & python-gdal bindings

I need to write a Lambda that uses GDAL. I've tried using https://github.com/developmentseed/geolambda, but I need the layer from eu-west-2 region due to other dependencies. I've tried other Lambda ...
Imran AK's user avatar
1 vote
1 answer
295 views

gdal /vsis3/ on NetCDF from Earthdata

I'm trying to access data from NASA's Earthdata S3 buckets, but I get a "<filename> does not exist in the file system, and is not recognized as a supported dataset name." error after ...
Bert Coerver's user avatar
  • 1,960
1 vote
2 answers
804 views

Converting shapefiles from S3 to GeoJSON in JavaScript for web map

I am working on a web map using OpenLayers and have encountered a challenge in converting shapefiles stored in an S3 bucket to GeoJSON using JavaScript. My goal is to display the converted shapefiles ...
JNN's user avatar
  • 135
2 votes
1 answer
72 views

Performance issues with Open Data Cube when `find_datasets` with a lot of results

Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
Sotosoul's user avatar
0 votes
0 answers
275 views

Is there a way to add XYZ Tile Layer to QGIS from an AWS bucket?

I am trying to add Map tiles from Pix4D to QGIS. Has anyone successfully accomplished this? I have loaded XYZ tiles to an Amazon AWS bucket and things seem to work fine with leaflet (LINK). The ...
Cary H's user avatar
  • 996
0 votes
1 answer
133 views

Can't create GeoServer data store from RDS PostGIS

I'm trying to add a PostGIS data store to my Geoserver but it is returning the below error: Error creating data store, check the parameters. Error message: Unable to obtain connection: Cannot create ...
Will's user avatar
  • 23
0 votes
0 answers
379 views

Bulk download from USGS The National Map (TNM)

I am looking for a way to bulk download data from the USGS The National Map (TNM). I found approximately 150 small (10MB) DEM tiles. The official USGS instructions are to download an open source ...
NW_Photo_Laureate's user avatar
1 vote
3 answers
552 views

GeoServer WMS is slow when using OpenLayers and OSM

I am new to GIS, and attempting to create a map with PostgreSQL/PostGIS,GeoServer, OpenLayers, and OSM data. I am only serving the NA continent, but it is taking approximately 20 seconds to render the ...
James Nebeker's user avatar
4 votes
0 answers
213 views

Reducing loading time of QGIS project

I have saved a couple of QGIS projects in a PostGIS DB, which is hosted in the cloud. The projects consist of different layers. When I open the QGIS projects, the loading time is very long. That is a ...
Enzo Baldini's user avatar
  • 2,337
3 votes
2 answers
1k views

"S3 Support for GeoTiff" vs "COG (Cloud Optimized GeoTIFF) Support" Geoserver Community Extensions

I have large raster datasets on AWS S3 (~100gb each) that I would like to serve as WMS through Geoserver. Has the "S3 Support for GeoTiff" extension been replaced by the "COG" one? ...
staf's user avatar
  • 326
0 votes
0 answers
285 views

QGIS PostgreSQL Amazon RDS AWS - id issue

This is a novice question. I created a database using Amazon RDS AWS. Then I connected it to my PostgreSQL. I am planning to utilize this for multi-user access to digitize blighted areas through QGIS. ...
kalaw23's user avatar
  • 139
3 votes
1 answer
3k views

GeoServer j_spring_security_check on Login

I have a GeoServer container that I am trying to push up to the AWS Cloud Environment. Things work as usual (default settings ) for my 19.2.2 version of GeoServer on my localhost. When I push the ...
zakariah1's user avatar
  • 211
0 votes
1 answer
344 views

Hosting Multiple GeoServer instances on the Same DNS

I have 2 instances of GeoServer that I am trying to run in the AWS Cloud environment on the same DNS. I am using Tomcat. https://testhost.com/geoserver https://testhost.com/geoserver-archive The load ...
zakariah1's user avatar
  • 211
0 votes
0 answers
182 views

Public AWS URL to Landsat-8 images - error 404

I'm not the only one having trouble downloading Landsat images from aws server using a URL like this: https://s3-us-west-2.amazonaws.com/landsat-pds/L8/017/008/LC80170082015211LGN00/index.html As in ...
jean Baba's user avatar
0 votes
1 answer
690 views

Connecting ArcGIS Online to PostgreSQL on Amazon Web Server

I have some key data sets stored on PostgreSQL on an Amazon Web Server. Is there any way, (direct or work around), that I can connect to this data in ArcGIS Online. I can connect to it with ArcGIS Pro,...
Olly Roberts's user avatar
1 vote
0 answers
317 views

Registering raster layers in Amazon RDS PostgreSQL using enable_out_db parameter

I have an AWS RDS PostgreSQL instance (v.11) that I'm currently storing vector data in. I also have a lot of raster layers in AWS S3 that are COG geotiffs. I'd like to register them in the database to ...
isostaticrbnd's user avatar
2 votes
1 answer
5k views

Error trying to open NetCDF file with xarray from s3 bucket

I'm trying to open a .nc file from an S3 bucket using xarray, but I'm getting an error. Here's the method I'm using: import xarray as xr aws_url = 's3://nasanex/NEX-GDDP/BCSD/rcp85/day/atmos/tasmax/...
JWB's user avatar
  • 604
1 vote
1 answer
403 views

Getting 404 response while fetching Landsat-8 data from AWS S3

I am trying to fetch Landsat-8 satellite data from AWS S3 and for getting details, I am using gdalinfo command: gdalinfo /vsicurl/https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/144/048/...
Shubham's user avatar
  • 11
0 votes
1 answer
452 views

Protecting Vector Tile Server Data

I am deploying a Vector Tile Server on AWS with data I don't want to make publicly available and there are two main elements I want to cover regarding the security of the data The tile server needs ...
arbermejo's user avatar
1 vote
1 answer
848 views

Create STAC catalog file for my s3 bucket

I have s3 private bucket which contains .tif files. Now, I need to create STAC file like the following: https://earth-search.aws.element84.com/v0 https://earthengine-stac.storage.googleapis.com/...
Cormogolov's user avatar
0 votes
1 answer
546 views

Does QGIS support AWS Redshift connection?

I am planning to connect AWS Redshift using QGIS for work purposes. However, I am not sure whether I can connect or not.
şener alkan's user avatar
1 vote
1 answer
119 views

Finding libraries for GRASS Installation Linux

I am installing GRASS on Linux. I have gotten as far as running Make in these instructions: https://grass.osgeo.org/grass78/binary/linux/snapshot/INSTALL I get this for multiple libraries: error while ...
sobmortin's user avatar
0 votes
1 answer
158 views

Installing GRASS on Linux

I am installing GRASS on Linux using source code and the ./configure file to create a standalone python script. I have been following instructions and installing relevant code like proj4 and GDAL and ...
sobmortin's user avatar
3 votes
2 answers
1k views

How to get Copernicus DEM GeoTIFFs for a bounding box using Python

Background According to AWS's Copernicus Digital Elevation Model page, The Copernicus DEM is a Digital Surface Model (DSM) which represents the surface of the Earth including buildings, ...
zabop's user avatar
  • 2,224
1 vote
1 answer
585 views

How to avoid (occasional) 404 errors when trying to access Sentinel-2 images using pystac-client

I use pystac-client to access some sentinel images. In Google Colab, I install pystac-client and rasterio by: %%shell pip install pystac-client pip install rasterio Import both modules: from ...
zabop's user avatar
  • 2,224
0 votes
1 answer
257 views

AWS GeoServer not responding

I made a WMS host with AWS. The WMS work with link below localhost:8080/geoserver/OSM/wms? But I'd like to reach it out of the network with this link and QGIS: http://ec2-xxx-xxx-xxx-xxx.us-east-2....
endy's user avatar
  • 91
1 vote
0 answers
200 views

QGIS Server Not Rendering VRT Layer that is accessing COGS on S3

I have deployed a QGIS server following steps in the user manual on an AWS EC-2 instance. https://docs.qgis.org/3.16/en/docs/server_manual/containerized_deployment.html#docker-stacks I am serving ...
ar-siddiqui's user avatar
  • 1,768
2 votes
1 answer
373 views

Intake-STAC: KeyError: 'open_stac_item_collection'

I downloaded the AWS Earth search notebook from the intake-stac examples and whithout changing anything. Just run the cells... But I've got everytime the error: KeyError: 'open_stac_item_collection' ...
ScienceNoob's user avatar
7 votes
1 answer
2k views

Trouble writing .tif from memory directly into S3 Bucket

I've used question on the topic as initial help and structured my code after it. I'm warping a raster file using these kwargs rast = gdal.Open(/vsicurl/raster_url) wkt = rast.GetProjection() outbounds ...
JWB's user avatar
  • 604
0 votes
1 answer
580 views

Licensing ArcGIS Enterprise when scaling in cloud environment [closed]

Esri's ArcGIS Enterprise licenses are for use on machines with "up to 4 cores". I understand that in cloud environments (such as AWS) that available machines have an equivalent number of ...
Andrew's user avatar
  • 11
1 vote
0 answers
223 views

DBSCAN with huge number of points

We have a dataset of approximately 30 million new points per month (latitude, longitude, and a measurement associated with that point). So far, we have applied DBSCAN to generate a monthly map such ...
Rourich's user avatar
  • 11
2 votes
1 answer
308 views

Synchronizing on-prem PostgreSQL raster database with AWS RDS

I have a folder of rasters that updates daily that I load into a PostgreSQL database using the raster2pgsql command line tool. I want to make this database outward facing so that I can connect to it. ...
JWB's user avatar
  • 604
3 votes
2 answers
4k views

HTTP request -to- AWS Lambda Python function -to- AGOL

I want to make an HTTP GET request to AGOL, but I want to route the request through a Python function. Since I can't host the Python function on AGOL (more info here), I'd like to use AWS-Lambda ...
User1974's user avatar
  • 1,172
2 votes
0 answers
154 views

Unable to list Sentinel l1c file using AWS CLI

Following Setting for AWS CLI using AWS configure AWS Access Key ID : ********** AWS Secret Access Key : ******** Default region name : eu-central-1 which I get from IAM user After setup I try to ...
gaurav singh's user avatar
1 vote
0 answers
147 views

Unable to execute QGIS algorithm while taking Input raster directly from AWS S3 account

I have a raster file (.TIF) in my AWS S3 account. I am using GDAL to open that .TIF file and to save the reprojected .TIF file to my local computer using QGIS GDAL 'Warp (reproject)' algorithm as ...
Sreeraj's user avatar
  • 729
0 votes
0 answers
139 views

Why is spatialite query taking so long (only) on first execution?

I have an AWS lambda function deployed with a spatialite table. When queried, a point lookup is done on the table to find the locations in the table containing the point. The first execution of the ...
user3559247's user avatar
1 vote
0 answers
190 views

Publishing PostGIS layer where PostgreSQL in Amazon RDS

I am trying to publish a PostGIS layer in GeoServer from my local machine. PostgreSQL is in AWS RDSs server. I am unable to see any features in layer preview. AWS RDS is SSL-enabled. it is worknig ...
surag's user avatar
  • 11
6 votes
2 answers
3k views

QGIS Read COG from S3

I am trying to read a Cloud Optimised GeoTiff (COG) from AWS S3. I can successfully run gdalinfo /vsis3/cog-testing/HP_COG.tif And see the details of the file and it says Layout: COG But if I ...
tjmgis's user avatar
  • 3,330
1 vote
0 answers
6k views

Writing Python list data into CSV file in multiple columns? [closed]

I am trying to write data into csv file from python list. I am using aws lambda for this...... My code fields = ['SnapshotId', 'StartDate'] csvio = io.StringIO() writer = csv.writer(csvio,delimiter=...
cloud_geek's user avatar
1 vote
1 answer
851 views

Spatial queries with PostgreSQL on AWS

I have some data in PostgreSQL which I am exporting to Amazon RDS service. Is it possible to use PostGIS extension in AWS? (And will I need the mandatory geom column or I could run queries with only ...
Tanya's user avatar
  • 11
2 votes
1 answer
1k views

How to download tile from Amazon’s Sentinel-2 service

How do I access Sentinel-2 imagery via Amazon? I'm new to GIS and have been relying on USGS earth explorer and EO Browser but would now like to access satellite imagery with higher resolution. I ...
user3821345's user avatar
1 vote
0 answers
201 views

Convert a AWS EC2 URL to WMS URL

I have built my tile server on AWS EC2 instance and want to use it as a base map in QGIS. When I try to add it as a WMS layer on QGIS, I get an error saying The server you are trying to connect to ...
vaishnavi mukundhan's user avatar