article thumbnail

Secrets from Data Governance Leaders: DGIQ West 2023 (June 5 – 9)

Alation

This year’s DGIQ West will host tutorials, workshops, seminars, general conference sessions, and case studies for global data leaders. He’ll share how “metadata normalization” played a key role in the journey to automation, the steps required to automate data governance processes, and why a data catalog was critical to the project’s success.

article thumbnail

Orca Security’s journey to a petabyte-scale data lake with Apache Iceberg and AWS Analytics

AWS Big Data

In addition, using Apache Iceberg’s metadata tables proved to be very helpful in identifying issues related to the physical layout of Iceberg’s tables, which can directly impact query performance. Orca monitored the cluster status and resource usage of Amazon EMR by utilizing the available metrics through Amazon CloudWatch.