article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

If the relationship of $X$ to $Y$ can be approximated as quadratic (or any polynomial), the objective and constraints as linear in $Y$, then there is a way to express the optimization as a quadratically constrained quadratic program (QCQP). However, joint optimization is possible by increasing both $x_1$ and $x_2$ at the same time.

article thumbnail

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

This is essentially the same as finding a truly useful objective to optimize. accounting for effects "orthogonal" to the randomization used in experimentation. Recently, we presented some basic insights from our effort to measure and predict long-term effects at KDD 2015 [1].

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. When there are changing assignment weights and time-based confounders, this complication must be considered either in the analysis or the experimental design.

article thumbnail

To Balance or Not to Balance?

The Unofficial Google Data Science Blog

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. It should be noted that inverse probability weighting is not generally optimal (i.e., This is often referred to as the positivity assumption. the curse of dimensionality).

article thumbnail

The 2015 Digital Marketing Rule Book. Change or Perish.

Occam's Razor

All while constantly optimizing your portfolio via controlled experiments. I told 20 people that Nikon's site is slow and profoundly sub-optimal on mobile. Companies get entrenched in what they know and end up constantly optimizing for what's always worked, meanwhile the world changes and these companies die, albeit slowly.

Marketing 140
article thumbnail

Themes and Conferences per Pacoid, Episode 11

Domino Data Lab

SQL optimization provides helpful analogies, given how SQL queries get translated into query graphs internally , then the real smarts of a SQL engine work over that graph. The query graph provides metadata that gets leveraged for optimizations at multiple layers of the relational database stack. A Sampler of Program Synthesis.

Metadata 105
article thumbnail

Themes and Conferences per Pacoid, Episode 6

Domino Data Lab

Spoiler alert: a research field called curiosity-driven learning is emerging at the nexis of experimental cognitive psychology and industry use cases for machine learning, particularly in gaming AI. Ensure a culture that supports a steady process of learning and experimentation. Friction ensued. You’ll need to read the papers.