DataKitchen

OCTOBER 2, 2023

Data Journeys track and monitor all levels of the data stack, from data to tools to code to tests across all critical dimensions. A Data Journey supplies real-time statuses and alerts on start times, processing durations, test results, and infrastructure events, among other metrics.

Data Quality 100

Data Quality Testing Uncertainty Data Enablement 100

O'Reilly on Data

MARCH 31, 2020

Machine learning adds uncertainty. The model outputs produced by the same code will vary with changes to things like the size of the training data (number of labeled examples), network training parameters, and training run time. Underneath this uncertainty lies further uncertainty in the development process itself.

Management 332

Management Machine Learning Experimentation Metrics 332

DataKitchen

SEPTEMBER 21, 2023

Bridging the Gap: How ‘Data in Place’ and ‘Data in Use’ Define Complete Data Observability In a world where 97% of data engineers report burnout and crisis mode seems to be the default setting for data teams, a Zen-like calm feels like an unattainable dream. What is Data in Use?

Testing 176

Testing Data Quality Predictive Modeling Metrics 176

O'Reilly on Data

OCTOBER 13, 2020

In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing. During testing and evaluation, application performance is important, but not critical to success. require not only disclosure, but also monitored testing. Debugging AI Products.

Management 244

Management Metrics Machine Learning Modeling 244

The Unofficial Google Data Science Blog

JULY 18, 2023

Once we’ve answered that, we will then define and use metrics to understand the quality of human-labeled data, along with a measurement framework that we call Cross-replication Reliability or xRR. Last, we’ll provide a case study of how xRR can be used to measure improvements in a data-labeling platform.

Measurement 52

Measurement Metrics Uncertainty Slice and Dice 52

Domino Data Lab

JUNE 23, 2019

Companies with successful ML projects are often companies that already have an experimental culture in place as well as analytics that enable them to learn from data. Ensure that product managers work on projects that matter to the business and/or are aligned to strategic company metrics. It is similar to R&D. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110