Skip to main content

Questions tagged [dask]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
80 views

Using dask.distributed with rioxarray rio.to_raster results in `ValueError: Lock is not yet acquired` [closed]

I am trying to write some code using dask.distributed.Client and rioxarray to_raster that: Concatenates two rasters (dask arrays) Applies a function across all blocks in the concatenated array Writes ...
katieb1's user avatar
  • 31
0 votes
0 answers
41 views

Earth Engine client library not initialized when using a dask cluster and xarray?

I'm trying to test running a simple math operation client-side using xee, an xarray extension for the Google Earth Engine API. When I set up the Dask client and run the compute() method I keep getting ...
Adriano Matos's user avatar
0 votes
1 answer
49 views

xee: Total request size (56623104 bytes) must be less than or equal to 50331648 bytes

I am using xee, an extension of xarray to work with data from Google Earth Engine. I am trying to test computing NDVI through an xarray of Landsat imagery, but I keep getting this error. EEException: ...
Adriano Matos's user avatar
1 vote
0 answers
34 views

All-NaN slice encountered when apply xr_phenology function?

I want calculate vegetation phenology from ndvi netcdf dataset, I follow yours tutorials (DEA Australia and DEA Africa) to apply xr_phenology function , defined here. To avoid killed kernel of my ...
tazrart's user avatar
  • 169
0 votes
1 answer
107 views

Performance difference between xarray open_mfdataset and open_dataset

I'm dealing with CMIP6 Scenariomip data, I have eight ESMs precipitation grid that each one is composed by multiple netcdf files. There is one ESMs's netcdf files are seperately reserved every decade, ...
孟泽楷's user avatar
0 votes
0 answers
138 views

Low performance when writing a large xarray.DataArray with dask

I'm preprocessing HMASR data, the data contains multiple data files with format of netcdf, and each tile (1X1 degree) is a nc file. So I read it through xarray open_mfdataset() to mosaic it spatially ...
孟泽楷's user avatar
0 votes
1 answer
366 views

AttributeError: 'Dataset' object has no attribute 'rio' when using a LocalCluster from dask.distributed

I am trying to parallelize a function that uses a zarr datacube read from an s3 bucket to perform some calculations. However, when using a LocalCluster from dask.distributed, I lose the .rio accessor ...
LaserGlaciers's user avatar
1 vote
0 answers
26 views

Buffer Error when using xarray

When I tried to using python package "xarray" to read grib files, I got an error. It's quite weird, because I had did it successfully yesterday. This is my code: import xarray as xr import ...
qingsong's user avatar
1 vote
1 answer
727 views

Writing GeoTIFF from dask array using rioxarray in python results in "stripes" of no data

I am trying to write a large raster from a dask array to a GeoTIFF file, but am running into an issue where the resulting raster contains "stripes" of no data. The pixels that do contain ...
katieb1's user avatar
  • 31
1 vote
0 answers
84 views

Dask cluster stuck when loading data with Open Data Cube

I'm running an ODC instance indexing and loading Sentinel-2 L2A COGs from the Element84 bucket on AWS. I use a Dask.distributed cluster deployed in "fixed" mode, for the definition of "...
giob12's user avatar
  • 108
0 votes
1 answer
2k views

dask geopandas apply(): AttributeError: 'GeoDataFrame' object has no attribute 'name'

I have a function that takes a GeoSeries as input and returns a value. When I call said function over all rows in a large geodataframe (gdf) with gdf.apply(), setting the output as a new column in the ...
user20408's user avatar
  • 1,545