article thumbnail

Our quest for robust time series forecasting at scale

The Unofficial Google Data Science Blog

Selection and aggregation of forecasts from an ensemble of models to produce a final forecast. Quantification of forecast uncertainty via simulation-based prediction intervals. Calendaring was therefore an explicit feature of models within our framework, and we made considerable investment in maintaining detailed regional calendars.

article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

Let's listen in as Alistair discusses the lean analytics model… The Lean Analytics Cycle is a simple, four-step process that shows you how to improve a part of your business. Another way to find the metric you want to change is to look at your business model. The business model also tells you what the metric should be.

Metrics 156
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

Editor's note : The relationship between reliability and validity are somewhat analogous to that between the notions of statistical uncertainty and representational uncertainty introduced in an earlier post. But for more complicated metrics like xRR, our preference is to bootstrap when measuring uncertainty.

article thumbnail

Fact-based Decision-making

Peter James Thomas

A clear parallel would be credit risk in Retail Banking, but something as simple as an estimate of potentially delinquent debtors is an inherently statistical figure (albeit one that may not depend on the output of a statistical model). A model may for example spit out a figure like £12.4 The model is not saying that £12.4

Metrics 49
article thumbnail

Fitting Bayesian structural time series with the bsts R package

The Unofficial Google Data Science Blog

SCOTT Time series data are everywhere, but time series modeling is a fairly specialized area within statistics and data science. This post describes the bsts software package, which makes it easy to fit some fairly sophisticated time series models with just a few lines of R code. by STEVEN L. Forecasting (e.g.

article thumbnail

Estimating causal effects using geo experiments

The Unofficial Google Data Science Blog

On the other hand, for the models that we use, the standard error of the iROAS estimate is inversely proportional to the ad spend difference in the treatment group. The model regresses the outcomes $y_{1,i}$ on the incremental change in ad spend $delta_i$. The noisier the data, the higher the standard error. For example, $beta_2 = 3.1$