article thumbnail

Estimating the prevalence of rare events — theory and practice

The Unofficial Google Data Science Blog

Of course, any mistakes by the reviewers would propagate to the accuracy of the metrics, and the metrics calculation should take into account human errors. If we could separate bad videos from good videos perfectly, we could simply calculate the metrics directly without sampling. The missing verdicts create two problems.

Metrics 98
article thumbnail

Data Science, Past & Future

Domino Data Lab

You know, typically, when you think about running projects, running teams, in terms of setting the priorities for projects, in terms of describing, what are the key metrics for success for a project, that usually falls on product management. I can point to the year 2001. They’re being told they have to embrace uncertainty.