Remove Advertising Remove Experimentation Remove Metrics Remove Uncertainty
article thumbnail

Product Management for AI

Domino Data Lab

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Another pattern that I’ve seen in good PMs is that they’re very metric-driven.

article thumbnail

Misadventures in experiments for growth

The Unofficial Google Data Science Blog

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime. Such decisions involve an actual hypothesis test on specific metrics (e.g.

article thumbnail

Estimating causal effects using geo experiments

The Unofficial Google Data Science Blog

However, it is generally not possible to determine the incremental impact of advertising by merely observing such data across time. One approach that Google has long used to obtain causal estimates of the impact of advertising is geo experiments. What does it take to estimate the impact of online exposure on user behavior?