Remove Finance Remove Knowledge Discovery Remove Measurement Remove Risk
article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

Well, it turns out that depending on what it cares to measure, an LSOS might not have enough data. The practical consequence of this is that we can’t afford to be sloppy about measuring statistical significance and confidence intervals. Being dimensionless, it is a simple measure of the variability of a (non-negative) random variable.

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

One reason to do ramp-up is to mitigate the risk of never before seen arms. A ramp-up strategy may mitigate the risk of upsetting the site’s loyal users who perhaps have strong preferences for the current statistics that are shown. For the first example, consider a small website that is a platform for content on personal finance.