Questions tagged [open-data-cube]
The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.
103
questions
-1
votes
0
answers
27
views
Python and DEA Australia [closed]
Are there additional steps to run the DEA Australia notebooks outside of the Sandbox?
I've imported some demos into VSCode but having some issues running them. I'm guessing there are some additional ...
- 1
0
votes
2
answers
38
views
RuntimeError: Broken/missing geospatial data was found in file NetCDF (OpenDataCube)
I'm trying to index and load a time-stacked NetCDF file with OpenDataCube . Product Definition and Dataset.yaml files get from the link: How to index and load a time-stacked NetCDF file with Open Data ...
1
vote
1
answer
114
views
Starting with Open Data Cube [closed]
I am new to Open Data Cube (ODC), and I wish to know the steps I need to follow when working with our data (I am working on Sentinel-1 from ASF). This would be very helpful for me to stay on the ...
0
votes
1
answer
69
views
Using scripting languages other than Python on Digital Earth Australia Sandbox
I might be missing something obvious here, but am I able to use other scripting languages like for example R in the DEA (Digital Earth Australia) Sandbox?
For clarification the DEA sandbox is located ...
- 13
1
vote
0
answers
46
views
All-NaN slice encountered when apply xr_phenology function?
I want calculate vegetation phenology from ndvi netcdf dataset, I follow yours tutorials (DEA Australia and DEA Africa) to apply xr_phenology
function , defined here. To avoid killed kernel of my ...
- 169
1
vote
1
answer
62
views
DEA tools plotting module - can be applied to all xarray datasets? [closed]
I have a general question about the dea-tools plotting module. I am wondering if functions such as rgb can be applied generally to xarray datasets or if one must follow the method for loading in data (...
1
vote
0
answers
43
views
OpenDataCube / cube-in-a-box Installation Problem using PowerShell, Windows 10 [closed]
435.8 ERROR: Package 'deafrica-tools-2.3.2' requires a different Python: 3.8.10 not in '<3.12,>=3.9'
failed to solve: process "/bin/sh -c cd /tmp && git clone --depth 1 https://...
- 11
0
votes
1
answer
48
views
Gridworkflow intersection with other spatial objects such as a geodataframe
I am working with a large GridWorkFlow object; I am not able to load all the tiles due to in-memory compute resources (24.00 GB mem 8 CPU) and do not need to either. I am interested in intersecting ...
0
votes
1
answer
63
views
Digital Advisory Services for Rural Farmers using ML, GIS and RS [closed]
I am working on a GIS-based project to help with the delivery of advisory services to rural farmers. This project is demanding the use of Open-Data Cube and the SandBox environment. It is more like a ...
- 1
1
vote
0
answers
57
views
AttributeError when running dc.load command (ESA WorldCover Classification Notebook)
This issue was raised at Git Hub a few months ago, but unfortunately, there is no solution so far. Therefore, I decided to post it here in the hope of attracting the StackExchange community.
I am ...
- 33
1
vote
0
answers
113
views
Landsat from Planetary Computer unexpectedly turns up all no data in some regions
Using some code that gathers Landsat 8 collections from Microsoft Planetary Computer into Open Data Cube xarray using a stac search works fine in some regions but in others returns all nan values. ...
- 317
0
votes
1
answer
405
views
Loading data gives RuntimeWarning: invalid value encountered in cast
Here is my code
import datacube
from datacube.utils.cog import write_cog
dc = datacube.Datacube(app="test_da")
datasets = dc.find_datasets(product="test_da", ...
- 1
0
votes
1
answer
116
views
Exporting mean Sentinel-2 in Open Data Cube (ODC) for one time but multiple bands
A mean for a month of sentinel 2 data was created for 8 different bands.
I want to write and download this image into a geotiff. But this code doesn't seem to work.
# Compute a single mean from all ...
- 1
2
votes
1
answer
79
views
Performance issues with Open Data Cube when `find_datasets` with a lot of results
Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
- 61
2
votes
1
answer
272
views
Import local STAC catalog to Open Data Cube
What's the best way to import my own COGS in an S3 bucket into ODC?
I've currently used both PySTAC and RIO-STAC to generate local catalogs for S3 located tifs. Both methods produce jsons and the ...
- 21
0
votes
2
answers
215
views
Add a polygon as a clip parameter for WMS and WCS layer in Datacube OWS
I am trying to add a clip as a parameter for a WMS and WCS URL end point, but couldn't clip based on a polygon.
Adding bbox for WCS endpoint returns the bounding box, not the exact polygon as the name ...
- 1
3
votes
1
answer
656
views
Datacube ODC environment setup
Problem with ODC environment
I am trying to setup datacube following this tutorial:
https://docs.dea.ga.gov.au/notebooks/DEA_datasets/DEA_Water_Observations.html#Loading-data
The first section of code ...
- 31
1
vote
0
answers
90
views
Dask cluster stuck when loading data with Open Data Cube
I'm running an ODC instance indexing and loading Sentinel-2 L2A COGs from the Element84 bucket on AWS.
I use a Dask.distributed cluster deployed in "fixed" mode, for the definition of "...
- 108
1
vote
0
answers
213
views
Overlapping Sentinel-2 Granules in AOI
Ive been working on a Sentinel-2 median dataset at the country level using Open Data Cube. While my methodology works fine for the majority of areas, it performs poorly where there is an overlap of S-...
- 11
1
vote
0
answers
225
views
Ingesting Sentinel-1 dataset to opendatacube is not working
I was trying to ingest Sentinel-1 data to my docker container which i downloaded from github(cube-in-a-box). I launching container in aws ec2 machine. Before ingest data of Sentinel-1 I've already ...
- 25
3
votes
1
answer
188
views
dc.load return an empty dataset when using dimensions parameters (latitude-longitude or x-y)
I recently updated to version 1.8.6 of OpenDataCube and have issue with dc.load function.
For example when running:
ds = dc.load(product=product,
longitude=(min_lon, max_lon),
...
- 51
0
votes
0
answers
164
views
ODC Installation issue
I've tried to install ODC on my local
host but stuck on the UI installation
step.
After running this command:
source datacube_env/bin/activate
I got "no such file or directory" error.
I ...
0
votes
1
answer
204
views
Plotting Open Data Cube xarray data with two or more measurement parameters in the same axis
How can I plot the two measurement parameters (seasonal cover and permanent water cover) in the same axis as I want to compare them?
I have this code:
#load the cgls product
ds_cgls_builtcover = dc....
1
vote
1
answer
264
views
How to index Water Observations Data in Open Data Cube
I would like to index Water Observations Data which stored in AWS into Open Data Cube. I tried to use
datacube product add ./wo/ga_ls_wo_3.odc-product.yaml
s3-to-dc --stac --no-sign-request "s3://...
- 13
1
vote
1
answer
154
views
Index USGS surface temperature datasets into Open Data Cube
I have recently indexed USGS surface reflectance products in my local ODC, with help from @Alex except for Landsat 9 datasets. Now I am trying to index the surface temperature product and compiled a ...
- 115
1
vote
1
answer
199
views
Download USGS datasets on either Australia or Africa sandbox
Is it possible to use my own AWS credentials to download a landsat8 dataset from USGS on either of the Sandbox (Africa/Australia)? I tried the following which didn't work:
import boto3
from matplotlib....
- 115
0
votes
1
answer
265
views
Index USGS data Collection 2 in Open Data Cube
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
Following the suggestion in the above URL, I tried to index USGS data into the Open Data Cube. Product definition was ...
- 115
1
vote
1
answer
268
views
Indexing data from Microsoft Planetary Computer in Open Data Cube
I would like to index into ODC some data from the Sentinel-2 dataset available on Microsoft Planetary Computer (PC).
The main issue is with the PC's requirement of using tokens (SAS), which need to be ...
- 108
1
vote
1
answer
185
views
OSError: Failed to list error in Open Data Cube
I am trying to index sentinel-l2a-cogs following the guide here.
The product definition is added to the database.
(cubeenv) λ datacube product list
s2_l2a Sentinel-2a and Sentinel-2b imagery, ...
- 1,065
3
votes
2
answers
372
views
QGIS 3.20 and WMS-T is not passing the TIME parameter
I'm having trouble using QGIS version 3.20 on Mac OS with a WMS-T layer.
The WMS service is available at https://ows.dea.ga.gov.au/wms. The specific layer I'm using is the DEA Land Cover layer, named ...
- 13.5k
0
votes
1
answer
205
views
Error handling on missing dataset file
I'm working with the sentinel-2-l2a-cogs dataset hosted on AWS, trying to index some areas taking advantage of the STAC API provided by Element84.
Unfortunately, I ran across the item ...
- 108
1
vote
2
answers
187
views
Querying for a list of products using geospatial extents within datacube
I have latitude longitude extents for an area that I'd like to conduct analysis on.
My goal is to determine what products exist within those latitude longitude extents.
The documentation hints at ...
- 166
1
vote
1
answer
872
views
Create STAC catalog file for my s3 bucket
I have s3 private bucket which contains .tif files.
Now, I need to create STAC file like the following:
https://earth-search.aws.element84.com/v0
https://earthengine-stac.storage.googleapis.com/...
- 77
1
vote
2
answers
266
views
Indexing Copernicus Global Land Service data into ODC
I would like to index Copernicus Global Land Service data (that we can find in this site: https://land.copernicus.vgt.vito.be/manifest/) into Open Data Cube.
How can I do it without the need to ...
- 77
0
votes
1
answer
112
views
Publish local ingested products and not using s3 bucket in [datacube-ows]
I am interested in publishing ingested product in my local Opendatacube instance. Everything working fine.
As far I know datacube-ows provides capabilities to offer OGC web services. Reading its ...
- 123
2
votes
0
answers
65
views
Indexing USGS Landsat Collection 2 data in Open Data Cube [duplicate]
The USGS Landsat Collection 2 data has been released for a while and there's no clear way to index it into the Open Data Cube.
Is there a prepare script or some other method that can be used to index ...
- 77
1
vote
1
answer
85
views
Can I use Copernicus Land Services data on Open Data Cube?
I need to use Copernicus Land services data (that I can take from the official website of Copernicus land: https://land.copernicus.eu/) on Open Data Cube.
How can I do it?
How can I index this data?
- 77
0
votes
1
answer
88
views
Datacube listing products fails 'Platform not in index'
ODC installation, Indexing and Ingestion complete for LANDSAT-8 SR products.
Now trying to execute notebooks for Cloud statistics computation using data_cube_notebooks
Responses of Notebook Cells ...
- 123
1
vote
1
answer
331
views
Error while indexing Sentinel 2 data on Open Data Cube
If I have sentinel 2 data:
which .py file do I have to use to create dataset?
which .yaml file do I have to use for product?
I took file from these 3 providers (https://earthexplorer.usgs.gov/ , ...
- 77
0
votes
1
answer
119
views
psycopg2 error when running datacube -v system init
I followed the instructions from here.
Open Data Cube core, version 1.8.6
Ubuntu 16.04
SQLAlchemy 1.4.27
After installation tried initialisation of database:
$ datacube -v system init
This ...
- 123
2
votes
1
answer
189
views
Indexing Multi-Band images in OpenDataCube
I have a Sentinel2 based product with the following product definition. It has 2 bands in it
name: product_name
description: Product Name
metadata_type: eo3
metadata:
product:
name: '...
2
votes
1
answer
160
views
Indexing rasters generated through algorithms into Open Data Cube database
I'm getting familiar with Open Data Cube and its process to index EO data from different sources but I could not find any example of indexing products/datasets created by algorithms (i.e. running in ...
- 108
2
votes
1
answer
280
views
Data indexing from DEAfrica STAC is not working
I am trying to index some Sentinel-1 data from the DEAfric STAC catalogue and have added the product using the following command
docker-compose exec jupyter datacube product add https://raw....
- 115
1
vote
0
answers
210
views
Open Data Cube: Local install of Cube in a Box indexing problems
I need to run ODC locally. I am trying to use the CIAB and following the instructions in its repo. I have failed a couple of times trying to index the examples.
When I first executed the command ...
- 611
2
votes
0
answers
100
views
Do the MTL.txt and ANG.txt need to be changed after reclassification using QGIS is done on one or two bands?
I had reclassified("Reclassify by table" in QGIS) the SWIR1 band value for a coastal erosion project to differentiate the land and the water better uisng QGIS and then replaced the SWIR1....
- 23
2
votes
1
answer
258
views
Unable to load the data product of Open Data Cube dataset image
I'm trying to load data product of the indexed Open Data Cube dataset image through the Jupyter Notebook. In this I'm using Resourcesat-2 AWiFS Data. The method used is shown below:
import matplotlib....
- 21
0
votes
1
answer
63
views
Fix location datacube-explorer
after indexing and add data to data cube. I want to show datasets in data cube-explorer but in the map affiche a wrong country how can I fix the location
- 3
2
votes
2
answers
11k
views
How to change certain values in an xarray depending on the coordinates
I have a Data Array with 4, 5 or 6 representing the classes: bare soil, vegetation and water.
cube1 =
<xarray.DataArray 'SCL_20m' (time: 5, y: 3, x: 3)>
array([[[4., 6., 6.],
[4., 4., ...
- 23
0
votes
1
answer
132
views
Cannot install datacube-explorer 2.5.4 version
When I try to install datacube-explorer v2.5.4 after extract it to a directory, enter the directory, and pip install . I have this error
- 3
0
votes
1
answer
129
views
Dataset documentation generation script for Landsat 8 collection 2 level 2 surface reflectance in ODC git repo fails to run [closed]
On running the script in the link below to generate the dataset documentation for data downloaded from USGS Landsat 8 Collection 2 Level 2, it ends in an error.
ls_usgs_sr_l2.py script
The error :
...
- 23