Questions tagged [open-data-cube]
The Open Data Cube is a software tool that makes it easier to work with large holdings of Earth observation data.
42
questions
0
votes
0answers
4 views
ODC DataSet Ingest requires all previous Ingests to be repeated? What are we doing wrong?
Having pretty much followed this Guide:
https://github.com/ceos-seo/data_cube_ui/blob/master/docs/old/indexing_and_ingestion.md#-brief-overview-of-processes
we can get large amounts of data indexed ...
1
vote
0answers
11 views
Inconsistent EO and EO3 Product Definition File Format handling
Is there a common mapping from the EO to the EO3 data formats for product defintion yaml files.
Are the following logically the same as they both cause differing problems during ODC data-in process.
...
0
votes
0answers
14 views
Using Digital Earth Africa collect_training_data tool on image collection data
On the Digital Earth Africa sandbox, I tried to apply this code to my study. In the code, the tool collect_training_data extracts the pixel values of an input image file, per polygon. I want to use ...
1
vote
1answer
19 views
How should ODC databases be restored and snapshot in Docker?
I have been trying to make an ODC index database state (products and their corresponding datasets) available (1) as a Docker image - probably kept locally due to its size - or (2) as a Docker volume. ...
1
vote
1answer
46 views
How to download the aerial linescan images from open data cube?
Below code gives the metadata information, using matplotlib the data can be plotted, but how can I download all the 134 aerial images in jpg format. Is there an option to download the image files ...
1
vote
0answers
22 views
Unable to load datasets from datacube using x,y, lat,lon or geopolygon
I get an empty array if I load the Landsat 8 dataset using x,y, lat,lon or geopolygon.
ds = dc.load(product='ls8_usgs_sr_scene',
time="2014-01-26",
geopolygon=geom,
...
2
votes
1answer
36 views
Why are the coordinates in the ODC different from the input data?
Why are the coordinates in the ODC different from the input data?
I prepared the following example for clarification and discussion. The used dataset is shown in the following two images:
Simple plot ...
1
vote
1answer
23 views
Ingesting Landsat8 Collection 1 Level 1 dataset
I am done with indexing, now trying to ingest. I couldn't find any examples for the ingest config for landsat8 collection 1 level 1, does anybody have any samples out there?
2
votes
1answer
42 views
Open data cube GeoTIFF indexing from MinIO/S3
I have large amounts of existing GeoTIFF data and I would need to find example how to index those to open data cube. Currently those reside in MinIO (S3 compliant store). In my understanding I would ...
0
votes
1answer
45 views
Slow response of Open Data Cube for large amount of polygons
I have indexed 5 Sentinel-2 images and I am requesting the data (10 bands and the 5 images) for each one of 180,000 polygons included in a shapefile.
Each request needs 8 seconds for the related data ...
0
votes
1answer
22 views
How can I index a scene with no data file for a measurement?
When indexing a scene that does not have a data file for a measurement defined in the product's definition, what is the best practice for indexing the scene such that ODC returns no data for it (more ...
1
vote
1answer
86 views
Indexing new data in the Open Data Cube
The cube in a box comes with an indexing script for Sentinel-2 data, as below
lon_center = XX.YY
lat_center = XZ.XY
buffer = 0.5
bbox = [lon_center - buffer, lat_center - buffer, lon_center + buffer,...
1
vote
2answers
69 views
How can I index USGS Landsat Collection 2 Level 2 datasets into the Open Data Cube?
I'm trying to ingest data using Landsat 8 Collection 2 Level 2 data into the Open Data Cube, but I couldn't find any examples for data preparation.
What is the best way to index USGS Landsat ...
4
votes
0answers
92 views
How to index and load a time-stacked NetCDF file with Open Data Cube?
Our use case is to make a time-stacked NetCDF file accessible via Open Data Cube.
Each NetCDF file (CMEMS data) has a time coordinate variable, with 8 time points evenly distributed over a range of ...
1
vote
2answers
44 views
How can a single Open Data Cube product be dumped from the index database?
How can a single product be dumped from the index database to be included in another index database? I know a few Postgres commands to dump the full agdc database within the Postgres database, but the ...
0
votes
1answer
65 views
Polygon Drill on Open Data Cube
I face a crucial problem with ODC. I try to do a spatial join with a shapefile (polygon drill). I have followed the following steps:
Read the shapefile and get the first polygon to test
Ensure that ...
0
votes
0answers
34 views
OpenDataCube OWS issue exposing Sentinel 5 tile
I am trying to index and expose a Sentinel 5 file (netcdf) with OpendataCube OWS (gdalinfo and ncdump available at the end of this post). The Sentinel-5 file is in the NetCDF4 format and uses ...
0
votes
0answers
30 views
Open Data Cube: Aggregation of pixels' value based on shapefile and mask raster
I have several Sentinel-2 products connected to ODC. My purpose is to use a shapefile with parcels in order to extract the average value of each parcel (creation of object based dataset). In addition, ...
1
vote
0answers
62 views
Loading Open Data Cube data to match a raster with geographic coordinates?
I would like to load a raster from a GeoTIFF file, and then load a time series of data from the Open Data Cube into the same CRS and resolution so I can use the raster as a mask. I can use the raster'...
0
votes
0answers
25 views
Open Data Cube: Unable to connect to database within opendatacube Conda environment [duplicate]
I followed the steps listed at https://cubes.readthedocs.io/en/v1.0.1/install.html
and did the following:
Installed Python
Installed PostgreSQL
ssudo sh -c 'echo "deb http://apt.postgresql.org/...
2
votes
0answers
75 views
Unable to connect to database within Conda Data Cube environment [closed]
I followed the steps listed at https://cubes.readthedocs.io/en/v1.0.1/install.html
and did the following:
Installed Python
Installed PostgreSQL
ssudo sh -c 'echo "deb http://apt.postgresql.org/...
2
votes
2answers
161 views
How to query data from an Open Data Cube (Python / Win 10)?
I would like to learn how to access and manipulate satellite images from an Open Data Cube (ODC) using Python. I have tried to follow the instructions found in https://datacube-core.readthedocs.io/en/...
0
votes
1answer
143 views
How to index USGS ARD Satellite Data into an Open Data Cube?
I am trying to index a Landsat8-Satellite-Dataset from Massachusetts in the USA. I downloaded the dataset from USGS. Below my question you can find the datacube-metadata.yaml-File. It is surface ...
2
votes
1answer
136 views
Why is there no XML-File with metadata when I download Landsat 8 data on USGS?
I am trying to create a Data Cube with Open Data Cube for my Bachelor's Thesis. In the Python-Files from Open Data Cube to prepare the data for indexing there is a XML-File with metadata needed:
https:...
0
votes
0answers
128 views
“No datacube config found” error
I am a beginner to this field and I am using Open Data Cube for the first time and after following the installation steps from (https://datacube-core.readthedocs.io/en/latest/ops/db_setup.html)
I am ...
3
votes
3answers
2k views
Mask xarray dataset using a shapefile [closed]
I have used xarray on some satellite data that I'd like to mask it using a shapefile. I have previously been doing this using a combination of PIL, numpy and gdal, but it would be cleaner to do this ...
1
vote
0answers
103 views
Adding new datasets to a product in Open Data Cube
I've created a product and ingested the dataset using standard command line inputs. As expected a new ODC netcdf format dataset is created according to the tiles and location specified. This allows me ...
1
vote
1answer
211 views
Installing command line tools for Open Data Cube?
I am trying to setup my own Open Data Cube environment, I did installed Postgres and datacube python libraries, but in order to initialise the database schema the following command is suggested:
...
1
vote
1answer
97 views
Trouble indexing data when following the cube-in-a-box installation steps
I have been trying to follow the cube-in-a-box installation steps and have ran into an issue when getting to the last step where we index the data.
I have taken the following steps when installing ...
0
votes
1answer
127 views
Get time stamps from TileWMS Layer Openlayers
I've got a WMS Layer which contains many different images at different times. I'm able to display in Openlayers the images from a single time period if I specify a "time" parameter in params. I've ...
0
votes
0answers
212 views
Tiled WMS server producing no data on Openlayers map?
I've been investigating setting up a server with OpenLayers which will display tiled data from a datacube-ows wms server. At the moment I have an index.html file which initializes the server and a wms....
2
votes
0answers
329 views
Using Open Data Cube Python API with remote data files?
My problem: I am unable to use Open Data Cube's Python API on a client machine to load and operate on centrally stored products/data files (i.e. which reside on a remote computer).
What I have tried:...
1
vote
1answer
134 views
Problem with datacube UI when I work with new dasaset added
I installed datacube from the official guide https://github.com/ceos-seo/data_cube_ui/tree/master/docs including the example. Everything works. I tried for simplicity to add a new app that calculates ...
3
votes
0answers
71 views
Creating a Data Cube from point measurements using ODC
I wonder if Open Data Cube software can also handle point measurements (none-raster information). I am interested to create a data cube for CYGNSS satellite data. Each CYGNSS data file (in netCDF ...
2
votes
1answer
3k views
TypeError: tuple indices must be integers or slices, not str after ingested data into the open data cube
I've ingested some landsat 5 images into a database using the open data cube. The problem is that when I try to run the continous change detection function following the jupyter notebook I get a ...
1
vote
1answer
696 views
Open Data Cube how to continue after the creation of the database?
I have some questions about using Open Data Cube. First of all I have successfully installed the virtual environment with miniconda and the database with PostgreSQLPortable-10.1.1.
Now I have already ...
1
vote
1answer
250 views
Conversion of GeoTIFF to NetCDF file doesn't create a NetCDF file but my database thinks it does
I am using miniconda and the Open Data Cube project. I am trying to ingest some Landsat_5 data into a datacube, where the geotiff are converted to netCDF files. Using the datacube code I used the ...
3
votes
1answer
306 views
Open Jupyter Notebook with Open Data Cube in docker
I run open data cube (ODC) docker (opendatacube-core and jupyterhub) and I expected that I can run jupyter notebook into it with ODC. However, I didn't. How can I run container (docker) of ODC and I ...
3
votes
1answer
198 views
Indexing to Open Data Cube not working for land cover map
I'm trying to index a clipped version of ESA's 2015 land cover map into an Open Data Cube instance. I've written a product specification yaml and a yaml for te actual product itself and it indexes ...
2
votes
1answer
158 views
What is the minimum `metadata` specification for the Open Data Cube?
There is a standard metadata definition here, but I would like to create a new one, with only the absolutely required fields.
What is the minimum set of values that can be used to define a metadata ...
4
votes
1answer
430 views
Is there an Open Data Cube (ODC) example/documentation on indexing data residing on Google Cloud
Are there any Open Data Cube (ODC) examples/documentation that cover indexing data residing on Google Cloud.
I know there is documentation on indexing data on AWS S3 at https://datacube-core....
2
votes
1answer
544 views
Writing custom Prepare Scripts for Open Data Cube?
How do I write custom prepare scripts for the Open Data Cube format ?
The docs say the following:
We expect that many new Data Cube instances will require custom prepare scripts to be written. It ...
