article thumbnail

Data Science, Past & Future

Domino Data Lab

One is data quality, cleaning up data, the lack of labelled data. They learned about a lot of process that requires that you get rid of uncertainty. They’re being told they have to embrace uncertainty. They’re years away from being up to that point. You know what? How could that make sense?

article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

Editor's note : The relationship between reliability and validity are somewhat analogous to that between the notions of statistical uncertainty and representational uncertainty introduced in an earlier post. But for more complicated metrics like xRR, our preference is to bootstrap when measuring uncertainty.