2007, Data mining, Strategy and Uncertainty

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

APRIL 23, 2024

Crucially, it takes into account the uncertainty inherent in our experiments. Experiments, Parameters and Models At Youtube, the relationships between system parameters and metrics often seem simple — straight-line models sometimes fit our data well. (And It is a big picture approach, worthy of your consideration.

Experimentation

Experimentation Optimization Uncertainty Metrics

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

JULY 22, 2020

by ALEXANDER WAKIM Ramp-up and multi-armed bandits (MAB) are common strategies in online controlled experiments (OCE). These strategies involve changing assignment weights during an experiment. The first is a strategy called ramp-up and is advised by many experts in the field [1].

Experimentation

Experimentation Statistics Testing Strategy

Data Leaders Brief

Towards optimal experimentation in online systems

Changing assignment weights with time-based confounders

Webinars

Stay Connected