2005, Analytics and Data Quality

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

JULY 18, 2023

This post describes a generic framework for understanding the quality of human-labeled data, based around the concepts of reliability and validity. It then goes on to show how a new framework called cross-replication reliability (xRR) implements these concepts and how several different analytical techniques implement this framework.

Measurement

Measurement Metrics Uncertainty Slice and Dice

Data Science, Past & Future

Domino Data Lab

JULY 22, 2019

You know, case in point, if you were to talk about predictive analytics 20 years ago, the main people in the field would have laughed you out of the room. Predictive analytics, yeah, not so much.” Data governance on big data, that was starting to happen. You also saw much more strategic use of data science.

Data Science

Data Science Machine Learning Data Governance Modeling

Data Leaders Brief

Measuring Validity and Reliability of Human Ratings

Data Science, Past & Future

Webinars

Stay Connected