The Unofficial Google Data Science Blog

OCTOBER 7, 2015

accounting for effects "orthogonal" to the randomization used in experimentation. For example in ads, experiments using cookies (users) as experimental units are not suited to capture the impact of a treatment on advertisers or publishers nor their reaction to it. To see this, imagine you want to study long-term effects in an A/B test.

Modeling 61

Modeling Experimentation Knowledge Discovery Testing 61

The Unofficial Google Data Science Blog

JANUARY 14, 2016

Unlike experimentation in some other areas, LSOS experiments present a surprising challenge to statisticians — even though we operate in the realm of “big data”, the statistical uncertainty in our experiments can be substantial. We must therefore maintain statistical rigor in quantifying experimental uncertainty.

Experimentation 41

Experimentation Statistics Metrics Measurement 41

Domino Data Lab

DECEMBER 4, 2020

Domino Lab supports both interactive and batch experimentation with all popular IDEs and notebooks (Jupyter, RStudio, SAS, Zeppelin, etc.). We can also check for missing values, although it appears that none are present. The analyses shown below are accessible in the NCA project on Domino’s trial site. x)), pain_df).

Metrics 59

Metrics Data Science Knowledge Discovery Measurement 59