Remove 2008 Remove Advertising Remove KDD Remove Metrics
article thumbnail

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning. For example in ads, experiments using cookies (users) as experimental units are not suited to capture the impact of a treatment on advertisers or publishers nor their reaction to it.