Experimentation, Knowledge Discovery, Measurement and Publishing

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

OCTOBER 7, 2015

by HENNING HOHNHOLD, DEIRDRE O'BRIEN, and DIANE TANG In this post we discuss the challenges in measuring and modeling the long-term effect of ads on user behavior. Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning.

Modeling

Modeling Experimentation Knowledge Discovery Testing

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

JULY 22, 2020

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. Companies like Google [2], Amazon [3], and Microsoft [4] have all published scholarly articles on this topic.

Experimentation

Experimentation Statistics Testing Strategy

Data Leaders Brief

Experiment design and modeling for long-term studies in ads

Changing assignment weights with time-based confounders

Webinars

Stay Connected