AWS Big Data

NOVEMBER 17, 2023

Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata. By using these statistics, CBO improves query run plans and boosts the performance of queries run in Athena.

Optimization 114

Optimization Statistics Metadata Data Lake 114

O'Reilly on Data

MAY 27, 2020

In 2001, just as the Lexile system was rolling out state-wide, a professor of education named Stephen Krashen took to the pages of the California School Library Journal to raise an alarm. The report has pages of careful caveats, but in the end it treats these risk-adjusted ratios as a good measure of a surgeon’s performance.

Risk 355

Risk Testing Reporting Measurement 355

IBM Big Data Hub

JULY 6, 2023

Areas making up the data science field include mining, statistics, data analytics, data modeling, machine learning modeling and programming. Ultimately, data science is used in defining new business problems that machine learning techniques and statistical analysis can then help solve.

Machine Learning 55

Machine Learning Data Science Statistics Deep Learning 55

Domino Data Lab

AUGUST 8, 2019

That’s a can-o-worms that exposes problems with Silicon Valley product management culture not entirely comprehending the real-world issues of MLOps. Consider the following timeline: 2001 – Physics grad students are getting hired in quantity by hedge funds to work on Wall St. Roll the clock out to Sci Foo.

Data Science 71

Data Science Machine Learning Data Governance Statistics 71

Domino Data Lab

JULY 22, 2019

He was saying this doesn’t belong just in statistics. It involved a lot of interesting work on something new that was data management. It involved a lot of work with applied math, some depth in statistics and visualization, and also a lot of communication skills. Tukey did this paper. It’s a great read.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

Domino Data Lab

JULY 9, 2019

I do not want a product manager being the information bottleneck between people who are supposed to do some research and develop a product that is useful and somebody who’s going to be the end user. In 2001, Bill Cleveland writes this article saying, “You are doing it wrong.” We can monetize that.”

Data Science 112

Data Science Machine Learning Advertising Modeling 112

Domino Data Lab

JANUARY 6, 2019

What are the projected risks for companies that fall behind for internal training in data science? Let me ask a question: as a manager, do you outsource that training? Over the years, people I’ve helped mentor in data science have become team leaders, managers, and executives. In business terms, why does this matter ?

Data Science 56

Data Science Machine Learning Reporting Visualization 56