O'Reilly on Data

MAY 11, 2020

The Entertainment” is not the result of algorithms, business incentives and product managers optimizing for engagement metrics. Television only lacked the immediate feedback that comes with clicks, tracking cookies, tracking pixels, online experimentation, machine learning, and “agile” product cycles.

Modeling 188

Modeling Advertising Recreation/Entertainment Metrics 188

The Unofficial Google Data Science Blog

OCTOBER 7, 2015

by HENNING HOHNHOLD, DEIRDRE O'BRIEN, and DIANE TANG In this post we discuss the challenges in measuring and modeling the long-term effect of ads on user behavior. Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning.

Modeling 61

Modeling Experimentation Knowledge Discovery Testing 61

Occam's Razor

APRIL 8, 2013

Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. First, you figure out what you want to improve; then you create an experiment; then you run the experiment; then you measure the results and decide what to do. Measure and decide what to do.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

Occam's Razor

OCTOBER 21, 2013

In late 2011, Google announced an effort to make search behavior more secure. As an analyst, I was upset that this change would hurt my ability to analyze the effectiveness of my beloved search engine optimization (SEO) efforts – which are really all about finding the right users using optimal content strategies.

Optimization 154

Optimization Reporting Experimentation Metrics 154

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

We data scientists now have access to tools that allow us to run a large numbers of experiments, and then to slice experimental populations by any combination of dimensions collected. Make experimentation cheap and understand the cost of bad decisions. This leads to the proliferation of post hoc hypotheses. What is to be done?

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

NOVEMBER 2, 2015

In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value. For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. It covers, content, marketing and measurement.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167