Variance and significance in large-scale online services
The Unofficial Google Data Science Blog
JANUARY 14, 2016
The LSOS may do this by exposing a random group of users to the new design and compare them to a control group, and then analyze the effect on important user engagement metrics, such as bounce rate, time to first action, or number of experiences deemed positive. In addition to a suitable metric, we must also choose our experimental unit.
Let's personalize your content