Data mining Experimentation Knowledge Discovery Metrics 
The Unofficial Google Data Science Blog
OCTOBER 7, 2015
Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning. accounting for effects "orthogonal" to the randomization used in experimentation. accounting for effects "orthogonal" to the randomization used in experimentation.
The Unofficial Google Data Science Blog
JANUARY 14, 2016
by AMIR NAJMI Running live experiments on large-scale online services (LSOS) is an important aspect of data science. We must therefore maintain statistical rigor in quantifying experimental uncertainty. In this post we explore how and why we can be “ data-rich but information-poor ”. And an LSOS is awash in data, right?
The Unofficial Google Data Science Blog
FEBRUARY 29, 2016
Despite a very large number of experimental units, the experiments conducted by LSOS cannot presume statistical significance of all effects they deem practically significant. The result is that experimenters can’t afford to be sloppy about quantifying uncertainty. In statistics, such segments are often called “blocks” or “strata”.
Expert insights. Personalized for you.
61 
Let's personalize your content