Remove 2011 Remove Data Collection Remove Modeling Remove Uncertainty
article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

Editor's note : The relationship between reliability and validity are somewhat analogous to that between the notions of statistical uncertainty and representational uncertainty introduced in an earlier post. Measurement challenges Assessing reliability is essentially a process of data collection and analysis.

article thumbnail

Our quest for robust time series forecasting at scale

The Unofficial Google Data Science Blog

Selection and aggregation of forecasts from an ensemble of models to produce a final forecast. Quantification of forecast uncertainty via simulation-based prediction intervals. We conclude with an example of our forecasting routine applied to publicly available Turkish Electricity data.

article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. Another way to find the metric you want to change is to look at your business model. The business model also tells you what the metric should be.

Metrics 156