2009, Metadata, Optimization and Uncertainty

Get started managing partitions for Amazon S3 tables backed by the AWS Glue Data Catalog

AWS Big Data

JUNE 22, 2023

If you simply run queries without considering the optimal data layout on Amazon S3, it results in a high volume of data scanned, long-running queries, and increased cost. Partitioning is a common technique to lay out your data optimally for distributed analytics engines. We also can see the partition metadata on the AWS Glue console.

Metadata

Metadata Management Recreation/Entertainment Optimization

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

APRIL 8, 2013

Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. You're choosing only one metric because you want to optimize it. By late 2009, that experiment was a success, too; they'd climbed back up to 4.5 But it is not routine. That metric is tied to a KPI.

Metrics

Metrics KPI Analytics Key Performance Indicator

Data Leaders Brief

Get started managing partitions for Amazon S3 tables backed by the AWS Glue Data Catalog

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Webinars

Stay Connected