The Unofficial Google Data Science Blog

JANUARY 14, 2016

Unlike experimentation in some other areas, LSOS experiments present a surprising challenge to statisticians — even though we operate in the realm of “big data”, the statistical uncertainty in our experiments can be substantial. We must therefore maintain statistical rigor in quantifying experimental uncertainty.

Experimentation 41

Experimentation Statistics Metrics Measurement 41

The Unofficial Google Data Science Blog

DECEMBER 4, 2019

This classification is based on the purpose, horizon, update frequency and uncertainty of the forecast. With those stakes and the long forecast horizon, we do not rely on a single statistical model based on historical trends. These characteristics of the problem drive the forecasting approaches.

Forecasting 113

Forecasting Data Science Statistics Uncertainty 113

The Unofficial Google Data Science Blog

JULY 22, 2020

For example, imagine a fantasy football site is considering displaying advanced player statistics. A ramp-up strategy may mitigate the risk of upsetting the site’s loyal users who perhaps have strong preferences for the current statistics that are shown. One reason to do ramp-up is to mitigate the risk of never before seen arms.

Experimentation 95

Experimentation Statistics Testing Strategy 95

BI-Survey

FEBRUARY 14, 2022

Overnight, the impact of uncertainty, dynamics and complexity on markets could no longer be ignored. Local events in an increasingly interconnected economy and uncertainties such as the climate crisis will continue to create high volatility and even chaos. The COVID-19 pandemic caught most companies unprepared. BARC Recommendations.

Forecasting 52

Forecasting Uncertainty Measurement Software 52

O'Reilly on Data

DECEMBER 9, 2019

Because of this trifecta of errors, we need dynamic models that quantify the uncertainty inherent in our financial estimates and predictions. Practitioners in all social sciences, especially financial economics, use confidence intervals to quantify the uncertainty in their estimates and predictions.

Statistics 27

Statistics Uncertainty Risk Marketing 27

The Unofficial Google Data Science Blog

FEBRUARY 29, 2016

In this post we explore why some standard statistical techniques to reduce variance are often ineffective in this “data-rich, information-poor” realm. Despite a very large number of experimental units, the experiments conducted by LSOS cannot presume statistical significance of all effects they deem practically significant.

Experimentation 40

Experimentation Metrics Statistics Measurement 40