Questions tagged [open-data-cube]
The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.
92
questions
0
votes
1
answer
284
views
Polygon Drill on Open Data Cube
I face a crucial problem with ODC. I try to do a spatial join with a shapefile (polygon drill). I have followed the following steps:
Read the shapefile and get the first polygon to test
Ensure that ...
CommunityBot
- 1
2
votes
0
answers
21
views
Performance issues with Open Data Cube when `find_datasets` with a lot of results
Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
- 19.7k
0
votes
0
answers
32
views
Error due to 'S2' is not defined when get to save data to table @open_data_cube
I have a set of code blocks that ran well earlier in February to grab Sentinel-2 10 bands for the AOI using open data cube. But for some reasons I don't know, it is giving me this error message "'...
- 13.7k
0
votes
2
answers
45
views
Add a polygon as a clip parameter for WMS and WCS layer in Datacube OWS
I am trying to add a clip as a parameter for a WMS and WCS URL end point, but couldn't clip based on a polygon.
Adding bbox for WCS endpoint returns the bounding box, not the exact polygon as the name ...
- 41
2
votes
1
answer
28
views
Import local STAC catalog to Open Data Cube
What's the best way to import my own COGS in an S3 bucket into ODC?
I've currently used both PySTAC and RIO-STAC to generate local catalogs for S3 located tifs. Both methods produce jsons and the ...
- 13.3k
2
votes
1
answer
121
views
dc.load return an empty dataset when using dimensions parameters (latitude-longitude or x-y)
I recently updated to version 1.8.6 of OpenDataCube and have issue with dc.load function.
For example when running:
ds = dc.load(product=product,
longitude=(min_lon, max_lon),
...
CommunityBot
- 1
3
votes
2
answers
214
views
QGIS 3.20 and WMS-T is not passing the TIME parameter
I'm having trouble using QGIS version 3.20 on Mac OS with a WMS-T layer.
The WMS service is available at https://ows.dea.ga.gov.au/wms. The specific layer I'm using is the DEA Land Cover layer, named ...
- 13k
3
votes
1
answer
159
views
Datacube ODC environment setup
Problem with ODC environment
I am trying to setup datacube following this tutorial:
https://docs.dea.ga.gov.au/notebooks/DEA_datasets/DEA_Water_Observations.html#Loading-data
The first section of code ...
1
vote
1
answer
178
views
Indexing data from Microsoft Planetary Computer in Open Data Cube
I would like to index into ODC some data from the Sentinel-2 dataset available on Microsoft Planetary Computer (PC).
The main issue is with the PC's requirement of using tokens (SAS), which need to be ...
- 98
1
vote
0
answers
53
views
Dask cluster stuck when loading data with Open Data Cube
I'm running an ODC instance indexing and loading Sentinel-2 L2A COGs from the Element84 bucket on AWS.
I use a Dask.distributed cluster deployed in "fixed" mode, for the definition of "...
- 98
0
votes
1
answer
105
views
Slow response of Open Data Cube for large amount of polygons
I have indexed 5 Sentinel-2 images and I am requesting the data (10 bands and the 5 images) for each one of 180,000 polygons included in a shapefile.
Each request needs 8 seconds for the related data ...
CommunityBot
- 1
0
votes
1
answer
86
views
Plotting Open Data Cube xarray data with two or more measurement parameters in the same axis
How can I plot the two measurement parameters (seasonal cover and permanent water cover) in the same axis as I want to compare them?
I have this code:
#load the cgls product
ds_cgls_builtcover = dc....
1
vote
0
answers
86
views
Overlapping Sentinel-2 Granules in AOI
Ive been working on a Sentinel-2 median dataset at the country level using Open Data Cube. While my methodology works fine for the majority of areas, it performs poorly where there is an overlap of S-...
- 19.7k
1
vote
1
answer
183
views
Trouble indexing data when following the cube-in-a-box installation steps
I have been trying to follow the cube-in-a-box installation steps and have ran into an issue when getting to the last step where we index the data.
I have taken the following steps when installing ...
1
vote
0
answers
140
views
Ingesting Sentinel-1 dataset to opendatacube is not working
I was trying to ingest Sentinel-1 data to my docker container which i downloaded from github(cube-in-a-box). I launching container in aws ec2 machine. Before ingest data of Sentinel-1 I've already ...
- 25
0
votes
0
answers
106
views
ODC Installation issue
I've tried to install ODC on my local
host but stuck on the UI installation
step.
After running this command:
source datacube_env/bin/activate
I got "no such file or directory" error.
I ...
- 19.7k
1
vote
0
answers
34
views
RGB Export in TIFF
How can I export my RGB results in TIFF format:
# Set the timesteps to visualise
timesteps = [0,1]
# Generate RGB plots at each timestep
rgb(ds_S1.where(ds_S1.mask==1), bands=['vh','vv','vhvv'], ...
- 19.7k
1
vote
1
answer
158
views
How to index Water Observations Data in Open Data Cube
I would like to index Water Observations Data which stored in AWS into Open Data Cube. I tried to use
datacube product add ./wo/ga_ls_wo_3.odc-product.yaml
s3-to-dc --stac --no-sign-request "s3://...
- 13.3k
1
vote
1
answer
95
views
Index USGS surface temperature datasets into Open Data Cube
I have recently indexed USGS surface reflectance products in my local ODC, with help from @Alex except for Landsat 9 datasets. Now I am trying to index the surface temperature product and compiled a ...
- 115
1
vote
1
answer
148
views
Download USGS datasets on either Australia or Africa sandbox
Is it possible to use my own AWS credentials to download a landsat8 dataset from USGS on either of the Sandbox (Africa/Australia)? I tried the following which didn't work:
import boto3
from matplotlib....
- 115
0
votes
1
answer
174
views
Index USGS data Collection 2 in Open Data Cube
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
Following the suggestion in the above URL, I tried to index USGS data into the Open Data Cube. Product definition was ...
- 13.3k
3
votes
2
answers
525
views
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
I'm trying to ingest data using Landsat 8 Collection 2 Level 2 data into the Open Data Cube, but I couldn't find any examples for data preparation.
How do I index USGS Landsat Collection 2 datasets ...
- 115
1
vote
1
answer
127
views
OSError: Failed to list error in Open Data Cube
I am trying to index sentinel-l2a-cogs following the guide here.
The product definition is added to the database.
(cubeenv) λ datacube product list
s2_l2a Sentinel-2a and Sentinel-2b imagery, ...
- 13.3k
7
votes
1
answer
505
views
How to index and load a time-stacked NetCDF file with Open Data Cube?
Our use case is to make a time-stacked NetCDF file accessible via Open Data Cube.
Each NetCDF file (CMEMS data) has a time coordinate variable, with 8 time points evenly distributed over a range of ...
- 61
1
vote
1
answer
435
views
Create STAC catalog file for my s3 bucket
I have s3 private bucket which contains .tif files.
Now, I need to create STAC file like the following:
https://earth-search.aws.element84.com/v0
https://earthengine-stac.storage.googleapis.com/...
- 13.3k
1
vote
1
answer
172
views
Load Landsat data from specific months using the Open Data Cube
I have a 32 year Landsat time series Open Data Cube query and I am interested in pulling out only two months per year of data (August and Feb).
Is there any way extracting data per month with the dc....
1
vote
2
answers
117
views
Querying for a list of products using geospatial extents within datacube
I have latitude longitude extents for an area that I'd like to conduct analysis on.
My goal is to determine what products exist within those latitude longitude extents.
The documentation hints at ...
- 72.4k
0
votes
1
answer
122
views
Error handling on missing dataset file
I'm working with the sentinel-2-l2a-cogs dataset hosted on AWS, trying to index some areas taking advantage of the STAC API provided by Element84.
Unfortunately, I ran across the item ...
- 64.6k
1
vote
2
answers
204
views
Indexing Copernicus Global Land Service data into ODC
I would like to index Copernicus Global Land Service data (that we can find in this site: https://land.copernicus.vgt.vito.be/manifest/) into Open Data Cube.
How can I do it without the need to ...
- 98
1
vote
1
answer
307
views
Open data cube GeoTIFF indexing from MinIO/S3
I have large amounts of existing GeoTIFF data and I would need to find example how to index those to open data cube. Currently those reside in MinIO (S3 compliant store). In my understanding I would ...
- 64.6k
0
votes
1
answer
71
views
Publish local ingested products and not using s3 bucket in [datacube-ows]
I am interested in publishing ingested product in my local Opendatacube instance. Everything working fine.
As far I know datacube-ows provides capabilities to offer OGC web services. Reading its ...
- 13.3k
1
vote
1
answer
55
views
Ingesting Landsat8 Collection 1 Level 1 dataset
I am done with indexing, now trying to ingest. I couldn't find any examples for the ingest config for landsat8 collection 1 level 1, does anybody have any samples out there?
CommunityBot
- 1
2
votes
0
answers
63
views
Indexing USGS Landsat Collection 2 data in Open Data Cube [duplicate]
The USGS Landsat Collection 2 data has been released for a while and there's no clear way to index it into the Open Data Cube.
Is there a prepare script or some other method that can be used to index ...
- 64.6k
1
vote
1
answer
65
views
Can I use Copernicus Land Services data on Open Data Cube?
I need to use Copernicus Land services data (that I can take from the official website of Copernicus land: https://land.copernicus.eu/) on Open Data Cube.
How can I do it?
How can I index this data?
- 64.6k
0
votes
1
answer
69
views
Datacube listing products fails 'Platform not in index'
ODC installation, Indexing and Ingestion complete for LANDSAT-8 SR products.
Now trying to execute notebooks for Cloud statistics computation using data_cube_notebooks
Responses of Notebook Cells ...
- 13.3k
2
votes
1
answer
93
views
Indexing rasters generated through algorithms into Open Data Cube database
I'm getting familiar with Open Data Cube and its process to index EO data from different sources but I could not find any example of indexing products/datasets created by algorithms (i.e. running in ...
- 13.3k
0
votes
1
answer
95
views
psycopg2 error when running datacube -v system init
I followed the instructions from here.
Open Data Cube core, version 1.8.6
Ubuntu 16.04
SQLAlchemy 1.4.27
After installation tried initialisation of database:
$ datacube -v system init
This ...
- 246
1
vote
1
answer
217
views
Error while indexing Sentinel 2 data on Open Data Cube
If I have sentinel 2 data:
which .py file do I have to use to create dataset?
which .yaml file do I have to use for product?
I took file from these 3 providers (https://earthexplorer.usgs.gov/ , ...
- 13.3k
2
votes
1
answer
115
views
Indexing Multi-Band images in OpenDataCube
I have a Sentinel2 based product with the following product definition. It has 2 bands in it
name: product_name
description: Product Name
metadata_type: eo3
metadata:
product:
name: '...
- 246
6
votes
3
answers
11k
views
Mask xarray dataset using a shapefile [closed]
I have used xarray on some satellite data that I'd like to mask it using a shapefile. I have previously been doing this using a combination of PIL, numpy and gdal, but it would be cleaner to do this ...
- 6,861
2
votes
1
answer
210
views
Data indexing from DEAfrica STAC is not working
I am trying to index some Sentinel-1 data from the DEAfric STAC catalogue and have added the product using the following command
docker-compose exec jupyter datacube product add https://raw....
- 3,626
1
vote
0
answers
169
views
Open Data Cube: Local install of Cube in a Box indexing problems
I need to run ODC locally. I am trying to use the CIAB and following the instructions in its repo. I have failed a couple of times trying to index the examples.
When I first executed the command ...
- 527
2
votes
0
answers
87
views
Do the MTL.txt and ANG.txt need to be changed after reclassification using QGIS is done on one or two bands?
I had reclassified("Reclassify by table" in QGIS) the SWIR1 band value for a coastal erosion project to differentiate the land and the water better uisng QGIS and then replaced the SWIR1....
- 23
2
votes
1
answer
205
views
Unable to load the data product of Open Data Cube dataset image
I'm trying to load data product of the indexed Open Data Cube dataset image through the Jupyter Notebook. In this I'm using Resourcesat-2 AWiFS Data. The method used is shown below:
import matplotlib....
- 13.3k
0
votes
1
answer
47
views
Fix location datacube-explorer
after indexing and add data to data cube. I want to show datasets in data cube-explorer but in the map affiche a wrong country how can I fix the location
- 246
1
vote
2
answers
7k
views
How to change certain values in an xarray depending on the coordinates
I have a Data Array with 4, 5 or 6 representing the classes: bare soil, vegetation and water.
cube1 =
<xarray.DataArray 'SCL_20m' (time: 5, y: 3, x: 3)>
array([[[4., 6., 6.],
[4., 4., ...
0
votes
1
answer
117
views
Cannot install datacube-explorer 2.5.4 version
When I try to install datacube-explorer v2.5.4 after extract it to a directory, enter the directory, and pip install . I have this error
- 246
0
votes
1
answer
104
views
Dataset documentation generation script for Landsat 8 collection 2 level 2 surface reflectance in ODC git repo fails to run [closed]
On running the script in the link below to generate the dataset documentation for data downloaded from USGS Landsat 8 Collection 2 Level 2, it ends in an error.
ls_usgs_sr_l2.py script
The error :
...
- 19.7k
2
votes
4
answers
145
views
Partial data loading from the Open Data Cube is not working
I have deployed the cube in a box docker in our local environment and managed to index a couple of Sentinel-2 level 2 data. However, when I tried to load my AOI from those datasets I receive an empty ...
- 115
1
vote
1
answer
57
views
NameError in Machine learning with Open Data Cube notebook code
I am trying to run the "Machine learning with the Open Data Cube" using my own .shp file but seem to keep getting the same error. The only cell that I altered in the following link is number ...
- 64.6k