AWS Big Data

NOVEMBER 17, 2023

Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata. By using these statistics, CBO improves query run plans and boosts the performance of queries run in Athena.

Optimization 112

Optimization Statistics Metadata Data Lake 112

Domino Data Lab

JULY 22, 2019

Paco Nathan presented, “Data Science, Past & Future” , at Rev. I am honored to be able to present here and thrilled to have been involved in Rev. He was saying this doesn’t belong just in statistics. The presentation layer was about, say, web browsers, right, what you could do in a web browser.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

Domino Data Lab

AUGUST 8, 2019

Secondly: some key insights discussed at Sci Foo finally clicked for me—after I’d heard them presented a few times elsewhere. The gist is, leveraging metadata about research datasets, projects, publications, etc., Across the board, organizations struggle with hiring enough data scientists. It’s a quick way to clear the room.

Data Science 71

Data Science Machine Learning Data Governance Statistics 71