2006, Experimentation, Metrics and Statistics

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

APRIL 23, 2024

the weight given to Likes in our video recommendation algorithm) while $Y$ is a vector of outcome measures such as different metrics of user experience (e.g., Experiments, Parameters and Models At Youtube, the relationships between system parameters and metrics often seem simple — straight-line models sometimes fit our data well.

Experimentation

Experimentation Optimization Uncertainty Metrics

Analytics On The Bleeding Edge: Transforming Data's Influence

Occam's Razor

MARCH 23, 2021

This is very hard to do, we now have a proven seven-step experimentation process, with one of the coolest algorithms to pick matched-markets (normally the kiss of death of any large-scale geo experiment). From 2006: Is Real-Time Analytics Really Relevant? ). The benchmark for the beautiful metric AVOC is 15.3%.

Analytics

Analytics Scorecard Strategy Testing

Data Leaders Brief

Towards optimal experimentation in online systems

Analytics On The Bleeding Edge: Transforming Data's Influence

Webinars

Stay Connected