Remove Book Remove Experimentation Remove Statistics Remove Uncertainty
article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

Unlike experimentation in some other areas, LSOS experiments present a surprising challenge to statisticians — even though we operate in the realm of “big data”, the statistical uncertainty in our experiments can be substantial. We must therefore maintain statistical rigor in quantifying experimental uncertainty.

article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

This thought was in my mind as I was reading Lean Analytics a new book by my friend Alistair Croll and his collaborator Benjamin Yoskovitz. They preserve almost all original intent, but if you read the book, or see the cycle elsewhere, please don''t be surprised to see a slightly different version. KPI: Property bookings.

Metrics 156