Remove Finance Remove Knowledge Discovery Remove Metrics Remove Testing
article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

The LSOS may do this by exposing a random group of users to the new design and compare them to a control group, and then analyze the effect on important user engagement metrics, such as bounce rate, time to first action, or number of experiences deemed positive. In addition to a suitable metric, we must also choose our experimental unit.