2001, Reference and Snapshot - Data Leaders Brief

Use AWS Glue ETL to perform merge, partition evolution, and schema evolution on Apache Iceberg

AWS Big Data

MARCH 4, 2024

Iceberg creates snapshots for the table contents. Each snapshot is a complete set of data files in the table at a point in time. Data files in snapshots are stored in one or more manifest files that contain a row for each data file in the table, its partition data, and its metrics.

Snapshot

Snapshot Data Lake Metadata Recreation/Entertainment

Modernize a legacy real-time analytics application with Amazon Managed Service for Apache Flink

AWS Big Data

OCTOBER 11, 2023

Frequent materialized view refreshes on top of constantly changing base tables due to streamed data can lead to snapshot isolation errors. For the template and setup information, refer to Test Your Streaming Data Solution with the New Amazon Kinesis Data Generator. We use two datasets in this post.

Management

Management Metadata Analytics Dashboards

Data Leaders Brief

Use AWS Glue ETL to perform merge, partition evolution, and schema evolution on Apache Iceberg

Modernize a legacy real-time analytics application with Amazon Managed Service for Apache Flink

Webinars

Stay Connected