Remove 2001 Remove IT Remove Metadata Remove Statistics
article thumbnail

Speed up queries with the cost-based optimizer in Amazon Athena

AWS Big Data

Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata. By using these statistics, CBO improves query run plans and boosts the performance of queries run in Athena.

article thumbnail

Themes and Conferences per Pacoid, Episode 12

Domino Data Lab

The gist is, leveraging metadata about research datasets, projects, publications, etc., Consider the following timeline: 2001 – Physics grad students are getting hired in quantity by hedge funds to work on Wall St. But first, let’s backup and discuss: what is this Foo thing anyway? Ever heard of it before? What’s a Foo?

article thumbnail

Data Science, Past & Future

Domino Data Lab

He was saying this doesn’t belong just in statistics. It involved a lot of work with applied math, some depth in statistics and visualization, and also a lot of communication skills. Paco Nathan: Thank you, Jon [Rooney]. I really appreciate it. I am honored to be able to present here and thrilled to have been involved in Rev.