Questions tagged [open-data-cube]

The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.

Filter by
Sorted by
Tagged with
9 votes
3 answers
15k views

Mask xarray dataset using a shapefile [closed]

I have used xarray on some satellite data that I'd like to mask it using a shapefile. I have previously been doing this using a combination of PIL, numpy and gdal, but it would be cleaner to do this ...
JackLidge's user avatar
  • 338
7 votes
1 answer
596 views

How to index and load a time-stacked NetCDF file with Open Data Cube?

Our use case is to make a time-stacked NetCDF file accessible via Open Data Cube. Each NetCDF file (CMEMS data) has a time coordinate variable, with 8 time points evenly distributed over a range of ...
christo52n's user avatar
4 votes
1 answer
714 views

Is there an Open Data Cube (ODC) example/documentation on indexing data residing on Google Cloud

Are there any Open Data Cube (ODC) examples/documentation that cover indexing data residing on Google Cloud. I know there is documentation on indexing data on AWS S3 at https://datacube-core....
Syed R Rizvi's user avatar
3 votes
2 answers
364 views

Finding all dates of particular dataset in Open Data Cube

I am trying to find all dates of a particular dataset in Open Data Cube. The closest function I could find was dc.index.datasets.get_product_time_bounds but that only provides the first and last date. ...
Arpit Kubadia 's user avatar
3 votes
1 answer
446 views

Datacube ODC environment setup

Problem with ODC environment I am trying to setup datacube following this tutorial: https://docs.dea.ga.gov.au/notebooks/DEA_datasets/DEA_Water_Observations.html#Loading-data The first section of code ...
Jordan's user avatar
  • 31
3 votes
1 answer
278 views

How to align X and Y pixel values to a boundary using the Open Data Cube

I am trying to load the following dataset into the DEA Sandbox: import datacube dc = datacube.Datacube(app="Landsat") import sys sys.path.append("./Scripts") from dea_datahandling ...
richard.turner's user avatar
3 votes
1 answer
337 views

How to filter Open Data Cube satellite data by cloud coverage similar to the Sentinel API?

I'm planning to use Sentinel API for a small region and have a time-space dataset filtered out by a cloud coverage percentage. Does someone know if I can do the same with Open Data Cube? i.e. when ...
Edu's user avatar
  • 33
3 votes
2 answers
619 views

Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube

I'm trying to ingest data using Landsat 8 Collection 2 Level 2 data into the Open Data Cube, but I couldn't find any examples for data preparation. How do I index USGS Landsat Collection 2 datasets ...
Zorro's user avatar
  • 41
3 votes
1 answer
556 views

Open Jupyter Notebook with Open Data Cube in docker

I run open data cube (ODC) docker (opendatacube-core and jupyterhub) and I expected that I can run jupyter notebook into it with ODC. However, I didn't. How can I run container (docker) of ODC and I ...
Diogo Caribé's user avatar
3 votes
2 answers
327 views

QGIS 3.20 and WMS-T is not passing the TIME parameter

I'm having trouble using QGIS version 3.20 on Mac OS with a WMS-T layer. The WMS service is available at https://ows.dea.ga.gov.au/wms. The specific layer I'm using is the DEA Land Cover layer, named ...
Alex Leith's user avatar
  • 13.4k
3 votes
1 answer
172 views

Inconsistent EO and EO3 Product Definition File Format handling

Is there a common mapping from the EO to the EO3 data formats for product defintion yaml files. Are the following logically the same as they both cause differing problems during ODC data-in process. ...
Diplonics's user avatar
  • 163
3 votes
1 answer
354 views

Indexing to Open Data Cube not working for land cover map

I'm trying to index a clipped version of ESA's 2015 land cover map into an Open Data Cube instance. I've written a product specification yaml and a yaml for te actual product itself and it indexes ...
JackLidge's user avatar
  • 338
3 votes
0 answers
83 views

Creating a Data Cube from point measurements using ODC

I wonder if Open Data Cube software can also handle point measurements (none-raster information). I am interested to create a data cube for CYGNSS satellite data. Each CYGNSS data file (in netCDF ...
vfreeman's user avatar
2 votes
4 answers
174 views

Partial data loading from the Open Data Cube is not working

I have deployed the cube in a box docker in our local environment and managed to index a couple of Sentinel-2 level 2 data. However, when I tried to load my AOI from those datasets I receive an empty ...
prpp2021's user avatar
  • 115
2 votes
1 answer
3k views

TypeError: tuple indices must be integers or slices, not str after ingested data into the open data cube

I've ingested some landsat 5 images into a database using the open data cube. The problem is that when I try to run the continous change detection function following the jupyter notebook I get a ...
Cam's user avatar
  • 255
2 votes
1 answer
218 views

What is the minimum `metadata` specification for the Open Data Cube?

There is a standard metadata definition here, but I would like to create a new one, with only the absolutely required fields. What is the minimum set of values that can be used to define a metadata ...
Alex Leith's user avatar
  • 13.4k
2 votes
1 answer
709 views

Data indexing problem with Open Data Cube

I'm trying to index the LISS-3 (Resourcesat) products to Open-Data-Cube. I'm connecting to the database (datacube) through the Anaconda prompt after activating the virtual environment (please see the ...
Badal's user avatar
  • 309
2 votes
1 answer
170 views

Indexing Multi-Band images in OpenDataCube

I have a Sentinel2 based product with the following product definition. It has 2 bands in it name: product_name description: Product Name metadata_type: eo3 metadata: product: name: '...
Arpit Kubadia 's user avatar
2 votes
1 answer
259 views

Data indexing from DEAfrica STAC is not working

I am trying to index some Sentinel-1 data from the DEAfric STAC catalogue and have added the product using the following command docker-compose exec jupyter datacube product add https://raw....
prpp2021's user avatar
  • 115
2 votes
1 answer
233 views

Unable to load the data product of Open Data Cube dataset image

I'm trying to load data product of the indexed Open Data Cube dataset image through the Jupyter Notebook. In this I'm using Resourcesat-2 AWiFS Data. The method used is shown below: import matplotlib....
Chhavi Tomar's user avatar
2 votes
1 answer
148 views

How should ODC databases be restored and snapshot in Docker?

I have been trying to make an ODC index database state (products and their corresponding datasets) available (1) as a Docker image - probably kept locally due to its size - or (2) as a Docker volume. ...
John Rattz's user avatar
2 votes
1 answer
384 views

Why is there no XML-File with metadata when I download Landsat 8 data on USGS?

I am trying to create a Data Cube with Open Data Cube for my Bachelor's Thesis. In the Python-Files from Open Data Cube to prepare the data for indexing there is a XML-File with metadata needed: https:...
Luisa Keller's user avatar
2 votes
1 answer
158 views

dc.load return an empty dataset when using dimensions parameters (latitude-longitude or x-y)

I recently updated to version 1.8.6 of OpenDataCube and have issue with dc.load function. For example when running: ds = dc.load(product=product, longitude=(min_lon, max_lon), ...
bchate's user avatar
  • 31
2 votes
1 answer
124 views

Indexing rasters generated through algorithms into Open Data Cube database

I'm getting familiar with Open Data Cube and its process to index EO data from different sources but I could not find any example of indexing products/datasets created by algorithms (i.e. running in ...
giob12's user avatar
  • 108
2 votes
2 answers
405 views

How to query data from an Open Data Cube (Python / Win 10)?

I would like to learn how to access and manipulate satellite images from an Open Data Cube (ODC) using Python. I have tried to follow the instructions found in https://datacube-core.readthedocs.io/en/...
farhat's user avatar
  • 151
2 votes
1 answer
730 views

Writing custom Prepare Scripts for Open Data Cube?

How do I write custom prepare scripts for the Open Data Cube format ? The docs say the following: We expect that many new Data Cube instances will require custom prepare scripts to be written. It ...
pLumo's user avatar
  • 6,449
2 votes
1 answer
55 views

Performance issues with Open Data Cube when `find_datasets` with a lot of results

Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
Sotosoul's user avatar
2 votes
1 answer
166 views

Import local STAC catalog to Open Data Cube

What's the best way to import my own COGS in an S3 bucket into ODC? I've currently used both PySTAC and RIO-STAC to generate local catalogs for S3 located tifs. Both methods produce jsons and the ...
Kurt Joy's user avatar
2 votes
0 answers
64 views

Indexing USGS Landsat Collection 2 data in Open Data Cube [duplicate]

The USGS Landsat Collection 2 data has been released for a while and there's no clear way to index it into the Open Data Cube. Is there a prepare script or some other method that can be used to index ...
Cormogolov's user avatar
2 votes
0 answers
91 views

Do the MTL.txt and ANG.txt need to be changed after reclassification using QGIS is done on one or two bands?

I had reclassified("Reclassify by table" in QGIS) the SWIR1 band value for a coastal erosion project to differentiate the land and the water better uisng QGIS and then replaced the SWIR1....
Qexpert's user avatar
  • 23
2 votes
1 answer
553 views

Unable to access Open Data Cube database through Jupyter notebook

I am trying to access the product added in Open Data Cube database through Jupyter notebook. I'm using this demo notebook. But I'm not able to connect to the database. The below line showing the error....
Badal's user avatar
  • 309
2 votes
0 answers
55 views

Unable to load datasets from datacube using x,y, lat,lon or geopolygon

I get an empty array if I load the Landsat 8 dataset using x,y, lat,lon or geopolygon. ds = dc.load(product='ls8_usgs_sr_scene', time="2014-01-26", geopolygon=geom, ...
jonk's user avatar
  • 63
2 votes
1 answer
148 views

Why are the coordinates in the ODC different from the input data?

Why are the coordinates in the ODC different from the input data? I prepared the following example for clarification and discussion. The used dataset is shown in the following two images: Simple plot ...
Eike's user avatar
  • 173
2 votes
0 answers
197 views

Unable to connect to database within Conda Data Cube environment [closed]

I followed the steps listed at https://cubes.readthedocs.io/en/v1.0.1/install.html and did the following: Installed Python Installed PostgreSQL ssudo sh -c 'echo "deb http://apt.postgresql.org/...
Supriya Sharma's user avatar
2 votes
0 answers
551 views

Using Open Data Cube Python API with remote data files?

My problem: I am unable to use Open Data Cube's Python API on a client machine to load and operate on centrally stored products/data files (i.e. which reside on a remote computer). What I have tried:...
user146714's user avatar
1 vote
1 answer
989 views

Open Data Cube how to continue after the creation of the database?

I have some questions about using Open Data Cube. First of all I have successfully installed the virtual environment with miniconda and the database with PostgreSQLPortable-10.1.1. Now I have already ...
Michele Spedalieri's user avatar
1 vote
2 answers
170 views

Querying for a list of products using geospatial extents within datacube

I have latitude longitude extents for an area that I'd like to conduct analysis on. ​ My goal is to determine what products exist within those latitude longitude extents. The documentation hints at ...
Conic's user avatar
  • 166
1 vote
1 answer
57 views

NameError in Machine learning with Open Data Cube notebook code

I am trying to run the "Machine learning with the Open Data Cube" using my own .shp file but seem to keep getting the same error. The only cell that I altered in the following link is number ...
Brianna's user avatar
  • 19
1 vote
1 answer
165 views

OSError: Failed to list error in Open Data Cube

I am trying to index sentinel-l2a-cogs following the guide here. The product definition is added to the database. (cubeenv) λ datacube product list s2_l2a Sentinel-2a and Sentinel-2b imagery, ...
Aman Bagrecha's user avatar
1 vote
1 answer
698 views

Create STAC catalog file for my s3 bucket

I have s3 private bucket which contains .tif files. Now, I need to create STAC file like the following: https://earth-search.aws.element84.com/v0 https://earthengine-stac.storage.googleapis.com/...
Cormogolov's user avatar
1 vote
2 answers
238 views

Indexing Copernicus Global Land Service data into ODC

I would like to index Copernicus Global Land Service data (that we can find in this site: https://land.copernicus.vgt.vito.be/manifest/) into Open Data Cube. How can I do it without the need to ...
Cormogolov's user avatar
1 vote
2 answers
244 views

Not able to plot Open Data Cube dataset image

I'm trying to plot the indexed Open Data Cube dataset image through the Jupyter Notebook. I'm using this demo notebook after making a clone of this repository on my local machine. The plot() method as ...
Badal's user avatar
  • 309
1 vote
1 answer
235 views

Load Landsat data from specific months using the Open Data Cube

I have a 32 year Landsat time series Open Data Cube query and I am interested in pulling out only two months per year of data (August and Feb). Is there any way extracting data per month with the dc....
Stephanie Johnson's user avatar
1 vote
1 answer
305 views

How to index USGS ARD Satellite Data into an Open Data Cube?

I am trying to index a Landsat8-Satellite-Dataset from Massachusetts in the USA. I downloaded the dataset from USGS. Below my question you can find the datacube-metadata.yaml-File. It is surface ...
user avatar
1 vote
1 answer
597 views

Installing command line tools for Open Data Cube?

I am trying to setup my own Open Data Cube environment, I did installed Postgres and datacube python libraries, but in order to initialise the database schema the following command is suggested: ...
user158344's user avatar
1 vote
1 answer
36 views

DEA tools plotting module - can be applied to all xarray datasets? [closed]

I have a general question about the dea-tools plotting module. I am wondering if functions such as rgb can be applied generally to xarray datasets or if one must follow the method for loading in data (...
Eilish Brennan's user avatar
1 vote
1 answer
212 views

How to index Water Observations Data in Open Data Cube

I would like to index Water Observations Data which stored in AWS into Open Data Cube. I tried to use datacube product add ./wo/ga_ls_wo_3.odc-product.yaml s3-to-dc --stac --no-sign-request "s3://...
Chenlu Hu's user avatar
1 vote
1 answer
127 views

Index USGS surface temperature datasets into Open Data Cube

I have recently indexed USGS surface reflectance products in my local ODC, with help from @Alex except for Landsat 9 datasets. Now I am trying to index the surface temperature product and compiled a ...
prpp2021's user avatar
  • 115
1 vote
1 answer
181 views

Download USGS datasets on either Australia or Africa sandbox

Is it possible to use my own AWS credentials to download a landsat8 dataset from USGS on either of the Sandbox (Africa/Australia)? I tried the following which didn't work: import boto3 from matplotlib....
prpp2021's user avatar
  • 115
1 vote
1 answer
74 views

Can I use Copernicus Land Services data on Open Data Cube?

I need to use Copernicus Land services data (that I can take from the official website of Copernicus land: https://land.copernicus.eu/) on Open Data Cube. How can I do it? How can I index this data?
Cormogolov's user avatar