Remove Modeling Remove Slice and Dice Remove Statistics Remove Uncertainty
article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

Editor's note : The relationship between reliability and validity are somewhat analogous to that between the notions of statistical uncertainty and representational uncertainty introduced in an earlier post. If they roll two dice and apply a label if the dice rolls sum to 12 they will agree 85% of the time, purely by chance.

article thumbnail

Data scientist as scientist

The Unofficial Google Data Science Blog

It is important to make clear distinctions among each of these, and to advance the state of knowledge through concerted observation, modeling and experimentation. Note also that this account does not involve ambiguity due to statistical uncertainty. We sliced and diced the experimental data in many many ways.