Remove Experimentation Remove KDD Remove Metrics Remove Optimization
article thumbnail

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning. This is essentially the same as finding a truly useful objective to optimize. accounting for effects "orthogonal" to the randomization used in experimentation.