The Unofficial Google Data Science Blog

JULY 22, 2020

This post considers a common design for an OCE where a user may be randomly assigned an arm on their first visit during the experiment, with assignment weights referring to the proportion that are randomly assigned to each arm. For example, imagine a fantasy football site is considering displaying advanced player statistics.

Experimentation 95

Experimentation Statistics Testing Strategy 95

Domino Data Lab

DECEMBER 4, 2020

Once all packages have been imported, we can move on to loading our test data. We can group by study arm and calculate various statistics as mean and standard deviation. We can then proceed with pharmacokinetic modeling, testing the goodness of fit of various models. References. [1] Non Compartmental Analysis.

Metrics 59

Metrics Data Science Knowledge Discovery Measurement 59

The Unofficial Google Data Science Blog

JANUARY 14, 2016

Unlike experimentation in some other areas, LSOS experiments present a surprising challenge to statisticians — even though we operate in the realm of “big data”, the statistical uncertainty in our experiments can be substantial. Because individual observations have so little information, statistical significance remains important to assess.

Experimentation 41

Experimentation Statistics Metrics Measurement 41