The Unofficial Google Data Science Blog

JULY 22, 2020

by ALEXANDER WAKIM Ramp-up and multi-armed bandits (MAB) are common strategies in online controlled experiments (OCE). These strategies involve changing assignment weights during an experiment. The first is a strategy called ramp-up and is advised by many experts in the field [1].

Experimentation 95

Experimentation Statistics Testing Strategy 95

Occam's Razor

SEPTEMBER 15, 2014

Nothing I can tell you about the importance of having an incredible mobile strategy will surprise you. In blue is how much time we spent in 2010 and in blue the time spent in 2014. was the dramatic shift between 2010 to 2014 to mobile content consumption. Create a distinct mobile website and mobile app measurement strategies.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

MARCH 23, 2010

For big success you'll need to have a Multiplicity strategy: So when you step back and realize at the minimum you'll also have to use one Voice of Customer tool (for qualitative analysis), one Experimentation tool and (if you want to be great) one Competitive Intelligence tool… do you still want to have two clickstream tools?

Analytics 118

Analytics Consulting Metrics Experimentation 118

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

Yet when we use these tools to explore data and look for anomalies or interesting features, we are implicitly formulating and testing hypotheses after we have observed the outcomes. We must correct for multiple hypothesis tests. Make experimentation cheap and understand the cost of bad decisions. We ought not dredge our data.

Experimentation 61

Experimentation Testing Statistics Metrics 61