article thumbnail

Build efficient, cross-Regional, I/O-intensive workloads with Dask on AWS

AWS Big Data

ERA5 ( historic_temp_regridded ) us-east-1 1512 711 427 202 Difference ( propogated pool ) us-west-2 and us-east-1 1527 906 469 251 The following graph visualizes the performance and scale. Number of Workers Compute Region 2(CMIP) + 2(ERA) 2(CMIP) + 4(ERA) 2(CMIP) + 8(ERA) 2(CMIP) + 12(ERA) CMIP6 ( predicted_tas_regridded ) us-west-2 11.8