O'Reilly on Data

MARCH 31, 2020

Machine learning adds uncertainty. Underneath this uncertainty lies further uncertainty in the development process itself. There are strategies for dealing with all of this uncertainty–starting with the proverb from the early days of Agile: “ do the simplest thing that could possibly work.”

Management 332

Management Machine Learning Experimentation Metrics 332

CIO Business Intelligence

JANUARY 4, 2023

Modern data analytics spans a range of technologies, from dedicated analytics platforms and databases to deep learning and artificial intelligence (AI). Ready to evolve your analytics strategy or improve your data quality? Just starting out with analytics? There’s always room to grow, and Intel is ready to help.

Cost-Benefit 59

Cost-Benefit Machine Learning Modeling Uncertainty 59

The Unofficial Google Data Science Blog

JULY 18, 2023

E ven after we account for disagreement, human ratings may not measure exactly what we want to measure. How do we think about the quality of human ratings, and how do we quantify our understanding is the subject of this post. While human-labeled data is critical to many important applications, it also brings many challenges.

Measurement 52

Measurement Metrics Uncertainty Slice and Dice 52

DataKitchen

SEPTEMBER 21, 2023

Bridging the Gap: How ‘Data in Place’ and ‘Data in Use’ Define Complete Data Observability In a world where 97% of data engineers report burnout and crisis mode seems to be the default setting for data teams, a Zen-like calm feels like an unattainable dream. What is Data in Use?

Testing 176

Testing Data Quality Predictive Modeling Metrics 176

O'Reilly on Data

OCTOBER 13, 2020

Ideally, AI PMs would steer development teams to incorporate I/O validation into the initial build of the production system, along with the instrumentation needed to monitor model accuracy and other technical performance metrics. But in practice, it is common for model I/O validation steps to be added later, when scaling an AI product.

Management 244

Management Metrics Machine Learning Modeling 244

IBM Big Data Hub

SEPTEMBER 11, 2023

Government executives face several uncertainties as they embark on their journeys of modernization. How to quantify the impact : Quantify, articulate and measure the expected long-term benefit of a capability to justify the investment. Through the analysis of collected data, potential opportunities for improvement are uncovered.

Data-driven 90

Data-driven IT Measurement Cost-Benefit 90

Peter James Thomas

AUGUST 12, 2018

This piece was prompted by both Olaf’s question and a recent article by my friend Neil Raden on his Silicon Angle blog, Performance management: Can you really manage what you measure? These and other areas are covered in greater detail in an older article, Using BI to drive improvements in data quality.

Metrics 49

Metrics Statistics Data Quality Measurement 49