Remove 2014 Remove Experimentation Remove Measurement Remove Risk
article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

the weight given to Likes in our video recommendation algorithm) while $Y$ is a vector of outcome measures such as different metrics of user experience (e.g., Taking measurements at parameter settings further from control parameter settings leads to a lower variance estimate of the slope of the line relating the metric to the parameter.

article thumbnail

To Balance or Not to Balance?

The Unofficial Google Data Science Blog

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. This algorithm is implemented in the SuperLearner R package (Polley & van der Laan, 2014). 2014): 243-263. This is often referred to as the positivity assumption.

article thumbnail

Themes and Conferences per Pacoid, Episode 6

Domino Data Lab

Spoiler alert: a research field called curiosity-driven learning is emerging at the nexis of experimental cognitive psychology and industry use cases for machine learning, particularly in gaming AI. The ability to measure results (risk-reducing evidence). and dig into details about where science meets rhetoric in data science.