Questions tagged [open-data-cube]
The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.
96
questions
9
votes
3
answers
13k
views
Mask xarray dataset using a shapefile [closed]
I have used xarray on some satellite data that I'd like to mask it using a shapefile. I have previously been doing this using a combination of PIL, numpy and gdal, but it would be cleaner to do this ...
- 338
7
votes
1
answer
535
views
How to index and load a time-stacked NetCDF file with Open Data Cube?
Our use case is to make a time-stacked NetCDF file accessible via Open Data Cube.
Each NetCDF file (CMEMS data) has a time coordinate variable, with 8 time points evenly distributed over a range of ...
- 71
4
votes
1
answer
679
views
Is there an Open Data Cube (ODC) example/documentation on indexing data residing on Google Cloud
Are there any Open Data Cube (ODC) examples/documentation that cover indexing data residing on Google Cloud.
I know there is documentation on indexing data on AWS S3 at https://datacube-core....
- 49
3
votes
2
answers
305
views
Finding all dates of particular dataset in Open Data Cube
I am trying to find all dates of a particular dataset in Open Data Cube.
The closest function I could find was dc.index.datasets.get_product_time_bounds but that only provides the first and last date.
...
3
votes
1
answer
263
views
Datacube ODC environment setup
Problem with ODC environment
I am trying to setup datacube following this tutorial:
https://docs.dea.ga.gov.au/notebooks/DEA_datasets/DEA_Water_Observations.html#Loading-data
The first section of code ...
- 31
3
votes
1
answer
235
views
How to align X and Y pixel values to a boundary using the Open Data Cube
I am trying to load the following dataset into the DEA Sandbox:
import datacube
dc = datacube.Datacube(app="Landsat")
import sys
sys.path.append("./Scripts")
from dea_datahandling ...
3
votes
1
answer
298
views
How to filter Open Data Cube satellite data by cloud coverage similar to the Sentinel API?
I'm planning to use Sentinel API for a small region and have a time-space dataset filtered out by a cloud coverage percentage.
Does someone know if I can do the same with Open Data Cube? i.e. when ...
- 33
3
votes
2
answers
559
views
Indexing USGS Landsat Collection 2 Level 2 datasets into Open Data Cube
I'm trying to ingest data using Landsat 8 Collection 2 Level 2 data into the Open Data Cube, but I couldn't find any examples for data preparation.
How do I index USGS Landsat Collection 2 datasets ...
- 41
3
votes
1
answer
524
views
Open Jupyter Notebook with Open Data Cube in docker
I run open data cube (ODC) docker (opendatacube-core and jupyterhub) and I expected that I can run jupyter notebook into it with ODC. However, I didn't. How can I run container (docker) of ODC and I ...
- 1,951
3
votes
2
answers
257
views
QGIS 3.20 and WMS-T is not passing the TIME parameter
I'm having trouble using QGIS version 3.20 on Mac OS with a WMS-T layer.
The WMS service is available at https://ows.dea.ga.gov.au/wms. The specific layer I'm using is the DEA Land Cover layer, named ...
- 13.3k
3
votes
1
answer
144
views
Inconsistent EO and EO3 Product Definition File Format handling
Is there a common mapping from the EO to the EO3 data formats for product defintion yaml files.
Are the following logically the same as they both cause differing problems during ODC data-in process.
...
- 163
3
votes
1
answer
328
views
Indexing to Open Data Cube not working for land cover map
I'm trying to index a clipped version of ESA's 2015 land cover map into an Open Data Cube instance. I've written a product specification yaml and a yaml for te actual product itself and it indexes ...
- 338
3
votes
0
answers
79
views
Creating a Data Cube from point measurements using ODC
I wonder if Open Data Cube software can also handle point measurements (none-raster information). I am interested to create a data cube for CYGNSS satellite data. Each CYGNSS data file (in netCDF ...
- 31
2
votes
4
answers
153
views
Partial data loading from the Open Data Cube is not working
I have deployed the cube in a box docker in our local environment and managed to index a couple of Sentinel-2 level 2 data. However, when I tried to load my AOI from those datasets I receive an empty ...
- 115
2
votes
1
answer
3k
views
TypeError: tuple indices must be integers or slices, not str after ingested data into the open data cube
I've ingested some landsat 5 images into a database using the open data cube. The problem is that when I try to run the continous change detection function following the jupyter notebook I get a ...
- 255
2
votes
1
answer
212
views
What is the minimum `metadata` specification for the Open Data Cube?
There is a standard metadata definition here, but I would like to create a new one, with only the absolutely required fields.
What is the minimum set of values that can be used to define a metadata ...
- 13.3k
2
votes
1
answer
606
views
Data indexing problem with Open Data Cube
I'm trying to index the LISS-3 (Resourcesat) products to Open-Data-Cube. I'm connecting to the database (datacube) through the Anaconda prompt after activating the virtual environment (please see the ...
- 199
2
votes
1
answer
136
views
Indexing Multi-Band images in OpenDataCube
I have a Sentinel2 based product with the following product definition. It has 2 bands in it
name: product_name
description: Product Name
metadata_type: eo3
metadata:
product:
name: '...
2
votes
1
answer
227
views
Data indexing from DEAfrica STAC is not working
I am trying to index some Sentinel-1 data from the DEAfric STAC catalogue and have added the product using the following command
docker-compose exec jupyter datacube product add https://raw....
- 115
2
votes
1
answer
215
views
Unable to load the data product of Open Data Cube dataset image
I'm trying to load data product of the indexed Open Data Cube dataset image through the Jupyter Notebook. In this I'm using Resourcesat-2 AWiFS Data. The method used is shown below:
import matplotlib....
- 21
2
votes
1
answer
136
views
How should ODC databases be restored and snapshot in Docker?
I have been trying to make an ODC index database state (products and their corresponding datasets) available (1) as a Docker image - probably kept locally due to its size - or (2) as a Docker volume. ...
- 151
2
votes
1
answer
330
views
Why is there no XML-File with metadata when I download Landsat 8 data on USGS?
I am trying to create a Data Cube with Open Data Cube for my Bachelor's Thesis. In the Python-Files from Open Data Cube to prepare the data for indexing there is a XML-File with metadata needed:
https:...
- 21
2
votes
1
answer
138
views
dc.load return an empty dataset when using dimensions parameters (latitude-longitude or x-y)
I recently updated to version 1.8.6 of OpenDataCube and have issue with dc.load function.
For example when running:
ds = dc.load(product=product,
longitude=(min_lon, max_lon),
...
- 31
2
votes
1
answer
100
views
Indexing rasters generated through algorithms into Open Data Cube database
I'm getting familiar with Open Data Cube and its process to index EO data from different sources but I could not find any example of indexing products/datasets created by algorithms (i.e. running in ...
- 98
2
votes
2
answers
360
views
How to query data from an Open Data Cube (Python / Win 10)?
I would like to learn how to access and manipulate satellite images from an Open Data Cube (ODC) using Python. I have tried to follow the instructions found in https://datacube-core.readthedocs.io/en/...
- 151
2
votes
1
answer
720
views
Writing custom Prepare Scripts for Open Data Cube?
How do I write custom prepare scripts for the Open Data Cube format ?
The docs say the following:
We expect that many new Data Cube instances will require custom prepare scripts to be written. It ...
- 6,399
2
votes
0
answers
35
views
Performance issues with Open Data Cube when `find_datasets` with a lot of results
Our ODC instance is deployed on AWS Aurora RDS and is populated with approximately 200 million datasets. The Aurora RDS is configured as Serverless v2 (64 - 128 ACUs) and has 4 replicas (1 writer + 3 ...
- 51
2
votes
1
answer
65
views
Import local STAC catalog to Open Data Cube
What's the best way to import my own COGS in an S3 bucket into ODC?
I've currently used both PySTAC and RIO-STAC to generate local catalogs for S3 located tifs. Both methods produce jsons and the ...
- 21
2
votes
0
answers
64
views
Indexing USGS Landsat Collection 2 data in Open Data Cube [duplicate]
The USGS Landsat Collection 2 data has been released for a while and there's no clear way to index it into the Open Data Cube.
Is there a prepare script or some other method that can be used to index ...
- 77
2
votes
0
answers
89
views
Do the MTL.txt and ANG.txt need to be changed after reclassification using QGIS is done on one or two bands?
I had reclassified("Reclassify by table" in QGIS) the SWIR1 band value for a coastal erosion project to differentiate the land and the water better uisng QGIS and then replaced the SWIR1....
- 23
2
votes
1
answer
469
views
Unable to access Open Data Cube database through Jupyter notebook
I am trying to access the product added in Open Data Cube database through Jupyter notebook. I'm using this demo notebook. But I'm not able to connect to the database.
The below line showing the error....
- 199
2
votes
0
answers
50
views
Unable to load datasets from datacube using x,y, lat,lon or geopolygon
I get an empty array if I load the Landsat 8 dataset using x,y, lat,lon or geopolygon.
ds = dc.load(product='ls8_usgs_sr_scene',
time="2014-01-26",
geopolygon=geom,
...
- 63
2
votes
1
answer
132
views
Why are the coordinates in the ODC different from the input data?
Why are the coordinates in the ODC different from the input data?
I prepared the following example for clarification and discussion. The used dataset is shown in the following two images:
Simple plot ...
- 173
2
votes
0
answers
190
views
Unable to connect to database within Conda Data Cube environment [closed]
I followed the steps listed at https://cubes.readthedocs.io/en/v1.0.1/install.html
and did the following:
Installed Python
Installed PostgreSQL
ssudo sh -c 'echo "deb http://apt.postgresql.org/...
2
votes
0
answers
521
views
Using Open Data Cube Python API with remote data files?
My problem: I am unable to use Open Data Cube's Python API on a client machine to load and operate on centrally stored products/data files (i.e. which reside on a remote computer).
What I have tried:...
- 21
1
vote
1
answer
961
views
Open Data Cube how to continue after the creation of the database?
I have some questions about using Open Data Cube. First of all I have successfully installed the virtual environment with miniconda and the database with PostgreSQLPortable-10.1.1.
Now I have already ...
1
vote
2
answers
135
views
Querying for a list of products using geospatial extents within datacube
I have latitude longitude extents for an area that I'd like to conduct analysis on.
My goal is to determine what products exist within those latitude longitude extents.
The documentation hints at ...
- 166
1
vote
1
answer
57
views
NameError in Machine learning with Open Data Cube notebook code
I am trying to run the "Machine learning with the Open Data Cube" using my own .shp file but seem to keep getting the same error. The only cell that I altered in the following link is number ...
- 19
1
vote
1
answer
140
views
OSError: Failed to list error in Open Data Cube
I am trying to index sentinel-l2a-cogs following the guide here.
The product definition is added to the database.
(cubeenv) λ datacube product list
s2_l2a Sentinel-2a and Sentinel-2b imagery, ...
- 995
1
vote
1
answer
544
views
Create STAC catalog file for my s3 bucket
I have s3 private bucket which contains .tif files.
Now, I need to create STAC file like the following:
https://earth-search.aws.element84.com/v0
https://earthengine-stac.storage.googleapis.com/...
- 77
1
vote
2
answers
215
views
Indexing Copernicus Global Land Service data into ODC
I would like to index Copernicus Global Land Service data (that we can find in this site: https://land.copernicus.vgt.vito.be/manifest/) into Open Data Cube.
How can I do it without the need to ...
- 77
1
vote
2
answers
214
views
Not able to plot Open Data Cube dataset image
I'm trying to plot the indexed Open Data Cube dataset image through the Jupyter Notebook. I'm using this demo notebook after making a clone of this repository on my local machine.
The plot() method as ...
- 199
1
vote
1
answer
191
views
Load Landsat data from specific months using the Open Data Cube
I have a 32 year Landsat time series Open Data Cube query and I am interested in pulling out only two months per year of data (August and Feb).
Is there any way extracting data per month with the dc....
1
vote
1
answer
291
views
How to index USGS ARD Satellite Data into an Open Data Cube?
I am trying to index a Landsat8-Satellite-Dataset from Massachusetts in the USA. I downloaded the dataset from USGS. Below my question you can find the datacube-metadata.yaml-File. It is surface ...
user166359
1
vote
1
answer
550
views
Installing command line tools for Open Data Cube?
I am trying to setup my own Open Data Cube environment, I did installed Postgres and datacube python libraries, but in order to initialise the database schema the following command is suggested:
...
- 11
1
vote
1
answer
106
views
Index USGS surface temperature datasets into Open Data Cube
I have recently indexed USGS surface reflectance products in my local ODC, with help from @Alex except for Landsat 9 datasets. Now I am trying to index the surface temperature product and compiled a ...
- 115
1
vote
1
answer
162
views
Download USGS datasets on either Australia or Africa sandbox
Is it possible to use my own AWS credentials to download a landsat8 dataset from USGS on either of the Sandbox (Africa/Australia)? I tried the following which didn't work:
import boto3
from matplotlib....
- 115
1
vote
1
answer
71
views
Can I use Copernicus Land Services data on Open Data Cube?
I need to use Copernicus Land services data (that I can take from the official website of Copernicus land: https://land.copernicus.eu/) on Open Data Cube.
How can I do it?
How can I index this data?
- 77
1
vote
1
answer
231
views
Error while indexing Sentinel 2 data on Open Data Cube
If I have sentinel 2 data:
which .py file do I have to use to create dataset?
which .yaml file do I have to use for product?
I took file from these 3 providers (https://earthexplorer.usgs.gov/ , ...
- 77
1
vote
1
answer
211
views
Product information on Open Data Cube is None and NaN
I'm trying to access the Open Data Cube product (indexed Landsat-8) through the Jupyter notebook. Except for the name and description, all other product information such as instrument, format, CRS, ...
- 199