Remove 2012 Remove Experimentation Remove Testing Remove Uncertainty
article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

Crucially, it takes into account the uncertainty inherent in our experiments. To find optimal values of two parameters experimentally, the obvious strategy would be to experiment with and update them in separate, sequential stages. In this section we’ll discuss how we approach these two kinds of uncertainty with QCQP.

article thumbnail

Estimating causal effects using geo experiments

The Unofficial Google Data Science Blog

Similarly, we could test the effectiveness of a search ad compared to showing only organic search results. A geo experiment is an experiment where the experimental units are defined by geographic regions. Structure of a geo experiment A typical geo experiment consists of two distinct time periods: pretest and test.