Remove 2012 Remove Modeling Remove Statistics Remove Uncertainty
article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

If $Y$ at that point is (statistically and practically) significantly better than our current operating point, and that point is deemed acceptable, we update the system parameters to this better value. Crucially, it takes into account the uncertainty inherent in our experiments. And sometimes even if it is not[1].)

article thumbnail

Our quest for robust time series forecasting at scale

The Unofficial Google Data Science Blog

Selection and aggregation of forecasts from an ensemble of models to produce a final forecast. Quantification of forecast uncertainty via simulation-based prediction intervals. Calendaring was therefore an explicit feature of models within our framework, and we made considerable investment in maintaining detailed regional calendars.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Science, Past & Future

Domino Data Lab

how “the business executives who are seeing the value of data science and being model-informed, they are the ones who are doubling down on their bets now, and they’re investing a lot more money.” He was saying this doesn’t belong just in statistics. Key highlights from the session include. Transcript. Tukey did this paper.

article thumbnail

Fitting Bayesian structural time series with the bsts R package

The Unofficial Google Data Science Blog

SCOTT Time series data are everywhere, but time series modeling is a fairly specialized area within statistics and data science. This post describes the bsts software package, which makes it easy to fit some fairly sophisticated time series models with just a few lines of R code. by STEVEN L. Forecasting (e.g.

article thumbnail

Using random effects models in prediction problems

The Unofficial Google Data Science Blog

KUEHNEL, and ALI NASIRI AMINI In this post, we give a brief introduction to random effects models, and discuss some of their uses. Through simulation we illustrate issues with model fitting techniques that depend on matrix factorization. Random effects models are a useful tool for both exploratory analyses and prediction problems.

article thumbnail

Estimating the prevalence of rare events — theory and practice

The Unofficial Google Data Science Blog

But importance sampling in statistics is a variance reduction technique to improve the inference of the rate of rare events, and it seems natural to apply it to our prevalence estimation problem. Statistical Science. Statistics in Biopharmaceutical Research, 2010. [4] 5] Ray Chambers, Robert Clark (2012). How Many Strata?

Metrics 98
article thumbnail

Estimating causal effects using geo experiments

The Unofficial Google Data Science Blog

Statistical power is traditionally given in terms of a probability function, but often a more intuitive way of describing power is by stating the expected precision of our estimates. This is a quantity that is easily interpretable and summarizes nicely the statistical power of the experiment.