2011, Data Strategy and Visualization

Build efficient, cross-Regional, I/O-intensive workloads with Dask on AWS

AWS Big Data

MAY 4, 2023

Dataset Variables Disk Size Xarray Dataset Size Region ERA5 2011–2020 (120 netcdf files) 53.5GB 364.1 ERA5 ( historic_temp_regridded ) us-east-1 1512 711 427 202 Difference ( propogated pool ) us-west-2 and us-east-1 1527 906 469 251 The following graph visualizes the performance and scale.

Data Processing

Data Processing Metadata Informatics Interactive

Themes and Conferences per Pacoid, Episode 8

Domino Data Lab

APRIL 3, 2019

So much data is flowing through the other parts, but that’s not the concern of DG solutions. Fun fact: in 2011 Google bought remnants of what had previously been Motorola. WhereHows is a DG project from LinkedIn, focused on big data. Apache Atlas is a Hadoop-ish native reference implementation for Egeria.

Data Governance

Data Governance Machine Learning Metadata Big Data

Data Leaders Brief

Build efficient, cross-Regional, I/O-intensive workloads with Dask on AWS

Themes and Conferences per Pacoid, Episode 8

Webinars

Stay Connected