The Unofficial Google Data Science Blog
OCTOBER 7, 2015
by HENNING HOHNHOLD, DEIRDRE O'BRIEN, and DIANE TANG In this post we discuss the challenges in measuring and modeling the long-term effect of ads on user behavior. Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning.
Domino Data Lab
AUGUST 6, 2021
It was first defined by the US Federal Reserve and Office of the Comptroller of the Currency ( SR 11-7 ) in April 2011. The process of doing data science is about learning from experimentation failures, but inadvertent errors can create enormous risks in model implementation. Model implementation.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Occam's Razor
APRIL 8, 2013
First, you figure out what you want to improve; then you create an experiment; then you run the experiment; then you measure the results and decide what to do. For each of them, write down the KPI you're measuring, and what that KPI should be for you to consider your efforts a success. Measure and decide what to do.
Occam's Razor
OCTOBER 21, 2013
In late 2011, Google announced an effort to make search behavior more secure. If you want to stress test this,… go back to your 2011 (pre- not provided ) data for paid and organic and see what you can find. Controlled experimentation. Measure the impact (remember you can measure at a Search Engine and Organic/Paid level).
The Unofficial Google Data Science Blog
MAY 31, 2016
It is important that we can measure the effect of these offline conversions as well. Panel studies make it possible to measure user behavior along with the exposure to ads and other online elements. Let's take a look at larger groups of individuals whose aggregate behavior we can measure. days or weeks).
The Unofficial Google Data Science Blog
OCTOBER 12, 2017
We data scientists now have access to tools that allow us to run a large numbers of experiments, and then to slice experimental populations by any combination of dimensions collected. Make experimentation cheap and understand the cost of bad decisions. This leads to the proliferation of post hoc hypotheses. What is to be done?
Occam's Razor
NOVEMBER 2, 2015
In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value. For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. It covers, content, marketing and measurement.
Expert insights. Personalized for you.
61 
Let's personalize your content