Remove 2023 Remove Data Processing Remove Snapshot Remove Testing
article thumbnail

Migrate an existing data lake to a transactional data lake using Apache Iceberg

AWS Big Data

An in-place migration can be performed in either of two ways: Using add_files : This procedure adds existing data files to an existing Iceberg table with a new snapshot that includes the files. Unlike migrate or snapshot, add_files can import files from a specific partition or partitions and doesn’t create a new Iceberg table.

Data Lake 103
article thumbnail

Find the best Amazon Redshift configuration for your workload using Redshift Test Drive

AWS Big Data

In this post, we answer that question by using Redshift Test Drive , an open-source tool that lets you evaluate which different data warehouse configurations options are best suited for your workload. Redshift Test Drive uses this process of workload replication for two main functionalities: comparing configurations and comparing replays.

Testing 66