Remove Big Data Remove Finance Remove Knowledge Discovery Remove Measurement
article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

For the first example, consider a small website that is a platform for content on personal finance. How willing your users are to engage with personal finance content depends on whether or not it’s the weekend. For this reason we don’t report uncertainty measures or statistical significance in the results of the simulation.

article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

by AMIR NAJMI Running live experiments on large-scale online services (LSOS) is an important aspect of data science. But the fact that a service could have millions of users and billions of interactions gives rise to both big data and methods which are effective with big data. And an LSOS is awash in data, right?

article thumbnail

LSOS experiments: how I learned to stop worrying and love the variability

The Unofficial Google Data Science Blog

For instance, the product offering of a personal finance website might be very different in different countries and hence conversion rates (acceptances per offer) might differ considerably by country. And since the metric average is different in each hour of day, this is a source of variation in measuring the experimental effect.