AWS Big Data

NOVEMBER 17, 2023

Amazon Athena is a serverless, interactive analytics service built on open source frameworks, supporting open table file formats. Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata.

Optimization 116

Optimization Statistics Metadata Data Lake 116

Domino Data Lab

APRIL 3, 2019

That’s a lot of priorities – especially when you group together closely related items such as data lineage and metadata management which rank nearby. Also, while surveying the literature two key drivers stood out: Risk management is the thin-edge-of-the-wedge ?for Allows metadata repositories to share and exchange. It’s a mess.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

Domino Data Lab

JULY 22, 2019

By virtue of that, if you take those log files of customers interactions, you aggregate them, then you take that aggregated data, run machine learning models on them, you can produce data products that you feed back into your web apps, and then you get this kind of effect in business. I can point to the year 2001. All righty.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

Domino Data Lab

AUGUST 8, 2019

The gist is, leveraging metadata about research datasets, projects, publications, etc., Consider the following timeline: 2001 – Physics grad students are getting hired in quantity by hedge funds to work on Wall St. The probabilistic nature changes the risks and process required. To wit: data science is a team sport.

Data Science 71

Data Science Machine Learning Data Governance Statistics 71