Remove Data Analytics Remove Optimization Remove Seminar Remove Snapshot
article thumbnail

Orca Security’s journey to a petabyte-scale data lake with Apache Iceberg and AWS Analytics

AWS Big Data

Determining optimal table partitioning Determining optimal partitioning for each table is very important in order to optimize query performance and minimize the impact on teams querying the tables when partitioning changes. The following diagram illustrates the solution architecture. Orca addressed this in several ways.