Remove Finance Remove Knowledge Discovery Remove Modeling Remove Testing
article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

Of particular interest to LSOS data scientists are modeling and prediction techniques which keep improving with more data. For this purpose, let’s assume we use a t-test for difference between group means. To observe this, let $W$ be the sample average differences between groups (our test statistic).

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

Another reason to use ramp-up is to test if a website's infrastructure can handle deploying a new arm to all of its users. The website wants to make sure they have the infrastructure to handle the feature while testing if engagement increases enough to justify the infrastructure. Here, day-of-week is a time-based confounder.