Machine Learning Metrics Slice and Dice Uncertainty 
The Unofficial Google Data Science Blog
JULY 18, 2023
Once we’ve answered that, we will then define and use metrics to understand the quality of human-labeled data, along with a measurement framework that we call Cross-replication Reliability or xRR. If they roll two dice and apply a label if the dice rolls sum to 12 they will agree 85% of the time, purely by chance.
The Unofficial Google Data Science Blog
OCTOBER 21, 2015
For example, in our field, we can generally blame machine learning feedback (predictions that change the data itself), budget effects (bidders running out of money in repeated auctions) or even the weather (internet usage changes in complicated ways). We sliced and diced the experimental data in many many ways.
Expert insights. Personalized for you.
52 
Let's personalize your content