Use Apache Iceberg in a data lake to support incremental data processing
AWS Big Data
MARCH 2, 2023
Whenever there is an update to the Iceberg table, a new snapshot of the table is created, and the metadata pointer points to the current table metadata file. At the top of the hierarchy is the metadata file, which stores information about the table’s schema, partition information, and snapshots. tableProperty("format-version", "2").partitionedBy($"product_category").createOrReplace()
117 
Let's personalize your content