2023, Experimentation, Snapshot and Testing

Improve operational efficiencies of Apache Iceberg tables built on Amazon S3 data lakes

AWS Big Data

MAY 24, 2023

The following examples are also available in the sample notebook in the aws-samples GitHub repo for quick experimentation. Update your-iceberg-storage-blog in the following configuration with the bucket that you created to test this example. Note the configuration parameters s3.write.tags.write-tag-name

Data Lake

Data Lake Snapshot Metadata Optimization

Unleashing the power of Presto: The Uber case study

IBM Big Data Hub

SEPTEMBER 25, 2023

If the exploratory work needs to move on to testing and production, they can plan appropriately. They ingest data in snapshots from operational systems. Next, they build model data sets out of the snapshots, cleanse and deduplicate the data, and prepare it for analysis as Parquet files. This way, the queries run much faster.

OLAP

OLAP Data Lake Data-driven Snapshot

Data Leaders Brief

Improve operational efficiencies of Apache Iceberg tables built on Amazon S3 data lakes

Unleashing the power of Presto: The Uber case study

Webinars

Stay Connected