article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

If $Y$ at that point is (statistically and practically) significantly better than our current operating point, and that point is deemed acceptable, we update the system parameters to this better value. And we can keep repeating this approach, relying on intuition and luck. Why experiment with several parameters concurrently?

article thumbnail

Analytics On The Bleeding Edge: Transforming Data's Influence

Occam's Razor

This is very hard to do, we now have a proven seven-step experimentation process, with one of the coolest algorithms to pick matched-markets (normally the kiss of death of any large-scale geo experiment). From 2006: Is Real-Time Analytics Really Relevant? ). What does the diminishing returns curve look like for TV GRPs for our company?

Analytics 131