The Unofficial Google Data Science Blog

JULY 22, 2020

by ALEXANDER WAKIM Ramp-up and multi-armed bandits (MAB) are common strategies in online controlled experiments (OCE). These strategies involve changing assignment weights during an experiment. The first is a strategy called ramp-up and is advised by many experts in the field [1].

Experimentation 95

Experimentation Statistics Testing Strategy 95

Occam's Razor

SEPTEMBER 15, 2014

Nothing I can tell you about the importance of having an incredible mobile strategy will surprise you. In blue is how much time we spent in 2010 and in blue the time spent in 2014. was the dramatic shift between 2010 to 2014 to mobile content consumption. Create a distinct mobile website and mobile app measurement strategies.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

MARCH 23, 2010

My problem with these mistruths and FUD is that they result in a ton of practitioners and companies making profoundly sub optimal choices, which in turn results in not just much longer slogs but also spectacular career implosions and the entire web analytics industry suffering. our measurement strategies 2. This is sad.

Analytics 118

Analytics Consulting Metrics Experimentation 118

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

We data scientists now have access to tools that allow us to run a large numbers of experiments, and then to slice experimental populations by any combination of dimensions collected. Make experimentation cheap and understand the cost of bad decisions. This leads to the proliferation of post hoc hypotheses. Consider your loss function.

Experimentation 61

Experimentation Testing Statistics Metrics 61