Build efficient, cross-Regional, I/O-intensive workloads with Dask on AWS
AWS Big Data
MAY 4, 2023
Dataset Variables Disk Size Xarray Dataset Size Region ERA5 2011–2020 (120 netcdf files) 53.5GB 364.1 ERA5 ( historic_temp_regridded ) us-east-1 1512 711 427 202 Difference ( propogated pool ) us-west-2 and us-east-1 1527 906 469 251 The following graph visualizes the performance and scale.
Let's personalize your content