2006, Experimentation, Statistics and Testing

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

APRIL 23, 2024

If $Y$ at that point is (statistically and practically) significantly better than our current operating point, and that point is deemed acceptable, we update the system parameters to this better value. And we can keep repeating this approach, relying on intuition and luck. Why experiment with several parameters concurrently?

Experimentation

Experimentation Optimization Uncertainty Metrics

Analytics On The Bleeding Edge: Transforming Data's Influence

Occam's Razor

MARCH 23, 2021

This is very hard to do, we now have a proven seven-step experimentation process, with one of the coolest algorithms to pick matched-markets (normally the kiss of death of any large-scale geo experiment). The first component is a gloriously scaled global creative pre-testing program. Matched market tests. The slow music.

Analytics

Analytics Scorecard Strategy Testing

Data Leaders Brief

Towards optimal experimentation in online systems

Analytics On The Bleeding Edge: Transforming Data's Influence

Webinars

Stay Connected