The Unofficial Google Data Science Blog

APRIL 23, 2024

This blog post discusses such a comprehensive approach that is used at Youtube. Crucially, it takes into account the uncertainty inherent in our experiments. To find optimal values of two parameters experimentally, the obvious strategy would be to experiment with and update them in separate, sequential stages.

Experimentation 52

Experimentation Optimization Uncertainty Metrics 52

The Unofficial Google Data Science Blog

JULY 22, 2020

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. When there are changing assignment weights and time-based confounders, this complication must be considered either in the analysis or the experimental design.

Experimentation 95

Experimentation Statistics Testing Strategy 95

O'Reilly on Data

DECEMBER 9, 2019

Recall from my previous blog post that all financial models are at the mercy of the Trinity of Errors , namely: errors in model specifications, errors in model parameter estimates, and errors resulting from the failure of a model to adapt to structural changes in its environment. The interval [-a, a] is called a 90% confidence interval.

Statistics 27

Statistics Uncertainty Risk Marketing 27