Questions tagged [open-data-cube]
The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.
103
questions
-1
votes
0
answers
25
views
Python and DEA Australia [closed]
Are there additional steps to run the DEA Australia notebooks outside of the Sandbox?
I've imported some demos into VSCode but having some issues running them. I'm guessing there are some additional ...
- 13.5k
0
votes
2
answers
213
views
Add a polygon as a clip parameter for WMS and WCS layer in Datacube OWS
I am trying to add a clip as a parameter for a WMS and WCS URL end point, but couldn't clip based on a polygon.
Adding bbox for WCS endpoint returns the bounding box, not the exact polygon as the name ...
CommunityBot
- 1
0
votes
2
answers
36
views
RuntimeError: Broken/missing geospatial data was found in file NetCDF (OpenDataCube)
I'm trying to index and load a time-stacked NetCDF file with OpenDataCube . Product Definition and Dataset.yaml files get from the link: How to index and load a time-stacked NetCDF file with Open Data ...
- 86
7
votes
1
answer
696
views
How to index and load a time-stacked NetCDF file with Open Data Cube?
Our use case is to make a time-stacked NetCDF file accessible via Open Data Cube.
Each NetCDF file (CMEMS data) has a time coordinate variable, with 8 time points evenly distributed over a range of ...
0
votes
1
answer
203
views
Plotting Open Data Cube xarray data with two or more measurement parameters in the same axis
How can I plot the two measurement parameters (seasonal cover and permanent water cover) in the same axis as I want to compare them?
I have this code:
#load the cgls product
ds_cgls_builtcover = dc....
CommunityBot
- 1
2
votes
1
answer
271
views
Import local STAC catalog to Open Data Cube
What's the best way to import my own COGS in an S3 bucket into ODC?
I've currently used both PySTAC and RIO-STAC to generate local catalogs for S3 located tifs. Both methods produce jsons and the ...
CommunityBot
- 1
1
vote
1
answer
111
views
Starting with Open Data Cube [closed]
I am new to Open Data Cube (ODC), and I wish to know the steps I need to follow when working with our data (I am working on Sentinel-1 from ASF). This would be very helpful for me to stay on the ...
- 20.2k
0
votes
1
answer
67
views
Using scripting languages other than Python on Digital Earth Australia Sandbox
I might be missing something obvious here, but am I able to use other scripting languages like for example R in the DEA (Digital Earth Australia) Sandbox?
For clarification the DEA sandbox is located ...
0
votes
1
answer
384
views
Polygon Drill on Open Data Cube
I face a crucial problem with ODC. I try to do a spatial join with a shapefile (polygon drill). I have followed the following steps:
Read the shapefile and get the first polygon to test
Ensure that ...
CommunityBot
- 1
1
vote
0
answers
45
views
All-NaN slice encountered when apply xr_phenology function?
I want calculate vegetation phenology from ndvi netcdf dataset, I follow yours tutorials (DEA Australia and DEA Africa) to apply xr_phenology
function , defined here. To avoid killed kernel of my ...
- 65.3k
0
votes
1
answer
402
views
Loading data gives RuntimeWarning: invalid value encountered in cast
Here is my code
import datacube
from datacube.utils.cog import write_cog
dc = datacube.Datacube(app="test_da")
datasets = dc.find_datasets(product="test_da", ...
CommunityBot
- 1
1
vote
1
answer
62
views
DEA tools plotting module - can be applied to all xarray datasets? [closed]
I have a general question about the dea-tools plotting module. I am wondering if functions such as rgb can be applied generally to xarray datasets or if one must follow the method for loading in data (...
1
vote
0
answers
42
views
OpenDataCube / cube-in-a-box Installation Problem using PowerShell, Windows 10 [closed]
435.8 ERROR: Package 'deafrica-tools-2.3.2' requires a different Python: 3.8.10 not in '<3.12,>=3.9'
failed to solve: process "/bin/sh -c cd /tmp && git clone --depth 1 https://...
- 11
0
votes
1
answer
48
views
Gridworkflow intersection with other spatial objects such as a geodataframe
I am working with a large GridWorkFlow object; I am not able to load all the tiles due to in-memory compute resources (24.00 GB mem 8 CPU) and do not need to either. I am interested in intersecting ...
- 7,509
2
votes
1
answer
79
views
Performance issues with Open Data Cube when `find_datasets` with a lot of results
Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
- 13.5k
0
votes
1
answer
63
views
Digital Advisory Services for Rural Farmers using ML, GIS and RS [closed]
I am working on a GIS-based project to help with the delivery of advisory services to rural farmers. This project is demanding the use of Open-Data Cube and the SandBox environment. It is more like a ...
- 21
1
vote
0
answers
56
views
AttributeError when running dc.load command (ESA WorldCover Classification Notebook)
This issue was raised at Git Hub a few months ago, but unfortunately, there is no solution so far. Therefore, I decided to post it here in the hope of attracting the StackExchange community.
I am ...
- 33
1
vote
0
answers
110
views
Landsat from Planetary Computer unexpectedly turns up all no data in some regions
Using some code that gathers Landsat 8 collections from Microsoft Planetary Computer into Open Data Cube xarray using a stac search works fine in some regions but in others returns all nan values. ...
- 317
0
votes
1
answer
114
views
Exporting mean Sentinel-2 in Open Data Cube (ODC) for one time but multiple bands
A mean for a month of sentinel 2 data was created for 8 different bands.
I want to write and download this image into a geotiff. But this code doesn't seem to work.
# Compute a single mean from all ...
- 61
3
votes
1
answer
188
views
dc.load return an empty dataset when using dimensions parameters (latitude-longitude or x-y)
I recently updated to version 1.8.6 of OpenDataCube and have issue with dc.load function.
For example when running:
ds = dc.load(product=product,
longitude=(min_lon, max_lon),
...
CommunityBot
- 1
3
votes
2
answers
371
views
QGIS 3.20 and WMS-T is not passing the TIME parameter
I'm having trouble using QGIS version 3.20 on Mac OS with a WMS-T layer.
The WMS service is available at https://ows.dea.ga.gov.au/wms. The specific layer I'm using is the DEA Land Cover layer, named ...
- 13.5k
3
votes
1
answer
654
views
Datacube ODC environment setup
Problem with ODC environment
I am trying to setup datacube following this tutorial:
https://docs.dea.ga.gov.au/notebooks/DEA_datasets/DEA_Water_Observations.html#Loading-data
The first section of code ...
1
vote
1
answer
268
views
Indexing data from Microsoft Planetary Computer in Open Data Cube
I would like to index into ODC some data from the Sentinel-2 dataset available on Microsoft Planetary Computer (PC).
The main issue is with the PC's requirement of using tokens (SAS), which need to be ...
- 108
1
vote
0
answers
90
views
Dask cluster stuck when loading data with Open Data Cube
I'm running an ODC instance indexing and loading Sentinel-2 L2A COGs from the Element84 bucket on AWS.
I use a Dask.distributed cluster deployed in "fixed" mode, for the definition of "...
- 108
0
votes
1
answer
144
views
Slow response of Open Data Cube for large amount of polygons
I have indexed 5 Sentinel-2 images and I am requesting the data (10 bands and the 5 images) for each one of 180,000 polygons included in a shapefile.
Each request needs 8 seconds for the related data ...
CommunityBot
- 1
1
vote
0
answers
210
views
Overlapping Sentinel-2 Granules in AOI
Ive been working on a Sentinel-2 median dataset at the country level using Open Data Cube. While my methodology works fine for the majority of areas, it performs poorly where there is an overlap of S-...
- 20.2k
1
vote
1
answer
219
views
Trouble indexing data when following the cube-in-a-box installation steps
I have been trying to follow the cube-in-a-box installation steps and have ran into an issue when getting to the last step where we index the data.
I have taken the following steps when installing ...
1
vote
0
answers
222
views
Ingesting Sentinel-1 dataset to opendatacube is not working
I was trying to ingest Sentinel-1 data to my docker container which i downloaded from github(cube-in-a-box). I launching container in aws ec2 machine. Before ingest data of Sentinel-1 I've already ...
- 25
0
votes
0
answers
164
views
ODC Installation issue
I've tried to install ODC on my local
host but stuck on the UI installation
step.
After running this command:
source datacube_env/bin/activate
I got "no such file or directory" error.
I ...
- 20.2k
1
vote
1
answer
263
views
How to index Water Observations Data in Open Data Cube
I would like to index Water Observations Data which stored in AWS into Open Data Cube. I tried to use
datacube product add ./wo/ga_ls_wo_3.odc-product.yaml
s3-to-dc --stac --no-sign-request "s3://...
- 13.5k
1
vote
1
answer
152
views
Index USGS surface temperature datasets into Open Data Cube
I have recently indexed USGS surface reflectance products in my local ODC, with help from @Alex except for Landsat 9 datasets. Now I am trying to index the surface temperature product and compiled a ...
- 115
1
vote
1
answer
197
views
Download USGS datasets on either Australia or Africa sandbox
Is it possible to use my own AWS credentials to download a landsat8 dataset from USGS on either of the Sandbox (Africa/Australia)? I tried the following which didn't work:
import boto3
from matplotlib....
- 115
0
votes
1
answer
265
views
Index USGS data Collection 2 in Open Data Cube
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
Following the suggestion in the above URL, I tried to index USGS data into the Open Data Cube. Product definition was ...
- 13.5k
3
votes
2
answers
698
views
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
I'm trying to ingest data using Landsat 8 Collection 2 Level 2 data into the Open Data Cube, but I couldn't find any examples for data preparation.
How do I index USGS Landsat Collection 2 datasets ...
- 115
1
vote
1
answer
185
views
OSError: Failed to list error in Open Data Cube
I am trying to index sentinel-l2a-cogs following the guide here.
The product definition is added to the database.
(cubeenv) λ datacube product list
s2_l2a Sentinel-2a and Sentinel-2b imagery, ...
- 13.5k
1
vote
1
answer
869
views
Create STAC catalog file for my s3 bucket
I have s3 private bucket which contains .tif files.
Now, I need to create STAC file like the following:
https://earth-search.aws.element84.com/v0
https://earthengine-stac.storage.googleapis.com/...
- 13.5k
1
vote
1
answer
276
views
Load Landsat data from specific months using the Open Data Cube
I have a 32 year Landsat time series Open Data Cube query and I am interested in pulling out only two months per year of data (August and Feb).
Is there any way extracting data per month with the dc....
1
vote
2
answers
187
views
Querying for a list of products using geospatial extents within datacube
I have latitude longitude extents for an area that I'd like to conduct analysis on.
My goal is to determine what products exist within those latitude longitude extents.
The documentation hints at ...
- 77.8k
0
votes
1
answer
205
views
Error handling on missing dataset file
I'm working with the sentinel-2-l2a-cogs dataset hosted on AWS, trying to index some areas taking advantage of the STAC API provided by Element84.
Unfortunately, I ran across the item ...
- 65.3k
1
vote
2
answers
265
views
Indexing Copernicus Global Land Service data into ODC
I would like to index Copernicus Global Land Service data (that we can find in this site: https://land.copernicus.vgt.vito.be/manifest/) into Open Data Cube.
How can I do it without the need to ...
- 108
1
vote
1
answer
462
views
Open data cube GeoTIFF indexing from MinIO/S3
I have large amounts of existing GeoTIFF data and I would need to find example how to index those to open data cube. Currently those reside in MinIO (S3 compliant store). In my understanding I would ...
- 65.3k
0
votes
1
answer
112
views
Publish local ingested products and not using s3 bucket in [datacube-ows]
I am interested in publishing ingested product in my local Opendatacube instance. Everything working fine.
As far I know datacube-ows provides capabilities to offer OGC web services. Reading its ...
- 13.5k
1
vote
1
answer
65
views
Ingesting Landsat8 Collection 1 Level 1 dataset
I am done with indexing, now trying to ingest. I couldn't find any examples for the ingest config for landsat8 collection 1 level 1, does anybody have any samples out there?
CommunityBot
- 1
2
votes
0
answers
65
views
Indexing USGS Landsat Collection 2 data in Open Data Cube [duplicate]
The USGS Landsat Collection 2 data has been released for a while and there's no clear way to index it into the Open Data Cube.
Is there a prepare script or some other method that can be used to index ...
- 65.3k
1
vote
1
answer
85
views
Can I use Copernicus Land Services data on Open Data Cube?
I need to use Copernicus Land services data (that I can take from the official website of Copernicus land: https://land.copernicus.eu/) on Open Data Cube.
How can I do it?
How can I index this data?
- 65.3k
0
votes
1
answer
88
views
Datacube listing products fails 'Platform not in index'
ODC installation, Indexing and Ingestion complete for LANDSAT-8 SR products.
Now trying to execute notebooks for Cloud statistics computation using data_cube_notebooks
Responses of Notebook Cells ...
- 13.5k
2
votes
1
answer
159
views
Indexing rasters generated through algorithms into Open Data Cube database
I'm getting familiar with Open Data Cube and its process to index EO data from different sources but I could not find any example of indexing products/datasets created by algorithms (i.e. running in ...
- 13.5k
0
votes
1
answer
119
views
psycopg2 error when running datacube -v system init
I followed the instructions from here.
Open Data Cube core, version 1.8.6
Ubuntu 16.04
SQLAlchemy 1.4.27
After installation tried initialisation of database:
$ datacube -v system init
This ...
- 246
1
vote
1
answer
329
views
Error while indexing Sentinel 2 data on Open Data Cube
If I have sentinel 2 data:
which .py file do I have to use to create dataset?
which .yaml file do I have to use for product?
I took file from these 3 providers (https://earthexplorer.usgs.gov/ , ...
- 13.5k
2
votes
1
answer
189
views
Indexing Multi-Band images in OpenDataCube
I have a Sentinel2 based product with the following product definition. It has 2 bands in it
name: product_name
description: Product Name
metadata_type: eo3
metadata:
product:
name: '...
- 246