article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

As with any enterprise, the goal of the service provider is to better satisfy its users and further its business objectives. Well, it turns out that depending on what it cares to measure, an LSOS might not have enough data. It is certainly true that for any given effect, statistical significance is an SMOD.