Remove blogs pervasive-data-intelligence-how-to-analyze-data-at-speed-and-scale
article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

by MICHAEL QUINN, JEREMY MILES, KA WONG As data scientists, we often encounter situations in which human judgment provides the ground truth. How do we think about the quality of human ratings, and how do we quantify our understanding is the subject of this post. Some of this data is human-labeled.