O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

Occam's Razor

JULY 24, 2018

To name a few: Digital Marketing & Measurement Model | Analytics Ecosystem | Web Analytics 2.0. During a discussion around planning for measurement, a peer was struggling with a unique collection of challenges. You see more digital metrics because digital is more measurable. Especially for the non-obvious problem #2 above.

Analytics 93

Analytics Metrics Strategy Measurement 93

datapine

FEBRUARY 4, 2020

Management thinker Peter Drucker once stated, “if you can’t measure it, you can’t improve it” – and he couldn’t be more right. Our final monthly report is providing a good overview of the performance of all your paid advertisement campaigns. 3) Online Advertising Performance. 2) Marketing Performance Report. click to enlarge**.

Reporting 280

Reporting Marketing Advertising Metrics 280

The Unofficial Google Data Science Blog

MAY 31, 2016

However, it is generally not possible to determine the incremental impact of advertising by merely observing such data across time. One approach that Google has long used to obtain causal estimates of the impact of advertising is geo experiments. It is important that we can measure the effect of these offline conversions as well.

Advertising 42

Advertising Testing Sales Statistics 42

The Unofficial Google Data Science Blog

JUNE 30, 2016

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. Your company has recently launched a new pickup truck, along with the corresponding online advertisement campaign. For example, imagine that you are working for a car manufacturer.

Statistics 44

Statistics Optimization Modeling Experimentation 44

The Unofficial Google Data Science Blog

APRIL 16, 2019

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime. But these are not usually amenable to A/B experimentation.

Experimentation 68

Experimentation Sales Metrics Measurement 68

Occam's Razor

FEBRUARY 28, 2017

The qualitative surveys measuring unhappiness went down even more than before. You are what you measure. Bonus: Remember, you can measure profit everyday in Google Analytics! ]. Applying it to digital advertising…. The success metric, ACT, did go down. Likelihood to repurchase , took a painful hit. Good behavior shift.

Key Performance Indicator 106

Key Performance Indicator Metrics Measurement Advertising 106

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. These measurement-obsessed companies have an advantage when it comes to AI.

Management 110

Management Machine Learning Experimentation Metrics 110

Occam's Razor

AUGUST 12, 2013

MCA-O2S covers the challenge of attributing the offline impact (revenue/brand value/butts in seats/phone calls/etc) driven by online marketing and advertising. MCA-AMS covers the challenge of attributing accurate impact of our marketing and advertising efforts across multiple devices (desktop, laptop, mobile, TV).

Modeling 161

Modeling Optimization Marketing Interactive 161

Occam's Razor

SEPTEMBER 15, 2014

A majority of YouTube consumption is on mobile, yet if there is an advertising or content strategy inside a company for YouTube it rarely accommodates for this reality. But why blame others, in this post let's focus on one important reason whose responsibility can be squarely put on your shoulders and mine: Measurement.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

MAY 27, 2015

Programmatic advertising is all the rage. Google's Adwords is perhaps the simplest example of programmatic advertising. I love the shift to intent-based targeting (I cannot stress how massively important to the future of advertising and marketing). Our advertising will rain down massive revenues! !" Does Yahoo!

Marketing Analytics 153

Marketing Analytics Marketing Analytics Advertising 153

Domino Data Lab

MAY 8, 2019

Visualizations are vital in data science work, with the caveat that the information that they convey may be 4-5 layers of abstraction away from the actual business process being measured. measure the subjects’ ability to trust the models’ results. Information can get quite distorted after being abstracted that many times.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

DECEMBER 12, 2016

" I think the answer expected was my view related to the size of the company or their industries or those that might have Google Analytics or those with big advertising spends etc. Digital Marketing & Measurement Model. What one critical metric will help you clearly measure performance for each strategy above?

Analytics 141

Analytics Data-driven Strategy Consulting 141

Occam's Razor

AUGUST 13, 2012

Yehoshua Coren: Best ways to measure user behavior in a multi-touch, multi-device digital world. What's possible to measure. What's not possible to measure. We all have smart phones, laptops, tablets and soon Smart TVs – but most of our measurements are usually done in Cookies that are device/browser specific.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

Occam's Razor

JANUARY 9, 2012

Most companies are astonishingly blasé about data and possibilities of measurement. " Sad, unimaginative measurements of their sad, unimaginative campaigns. But you can probably find 1000 people *relevant* to your brand and message by advertising on 28 *relevant* channels in the long tail (those after channel #14).

Marketing 140

Marketing B2B Measurement Risk 140

Occam's Razor

SEPTEMBER 30, 2013

That could possibly be considered advertising. They are often measured on impressions (or worse, "connections") and clicks. When you measure the success of your AdWords campaigns or your email blasts or your Facebook ads or any other acquisition initiative, make sure you report your macro-conversion rate.

Marketing Analytics 154

Marketing Analytics Marketing Visualization Analytics 154

Occam's Razor

OCTOBER 19, 2010

You'll measure Task Completion Rate in 4Q (below). You'll measure Share of Search using Insights for Search (below). Only a plea to obsessively obsess about measuring outcomes and compute economic value, not just revenue. Experimentation and Testing Tools [The "Why" – Part 1].

Analytics 135

Analytics Testing Measurement Optimization 135

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. They’re about having the mindset of an experimenter and being willing to let data guide a company’s decision-making process. The results?

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

Occam's Razor

APRIL 29, 2013

You measure bounce rate and you can find those things, then figure out if the problem is at the source (ads) or destination (your site). Because Likes (and +1s, Followers) measure a fleeting Hello. PS: Bonus : Facebook Advertising / Marketing: Best Metrics, ROI, Business Value. Bad ad creatives. Horrible landing pages.

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

NOVEMBER 2, 2015

For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). Measure all this Social Media activity.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

Sisense

NOVEMBER 23, 2020

You just need to look at some of the world’s leaders in advertising and marketing, like Facebook, who are pioneering how they target their customers using leading edge technology, and the wealth and abundance of data at our disposal these days, to see the true power of analytics in marketing.”. Right tools/open source.

Analytics 98

Analytics Data-driven Marketing Reporting 98

Occam's Razor

MARCH 7, 2016

Of course, measure that using the four best social media metrics !) There is no doubt that if you do something that catches fire (I refuse to use the v word), these rented platforms can really reach massively move people than you can all by yourself (often, you can't even get that reach with paid advertising). Maybe, maybe not.

Marketing Analytics 86

Marketing Analytics Marketing Analytics KPI 86

O'Reilly on Data

MAY 11, 2020

Television only lacked the immediate feedback that comes with clicks, tracking cookies, tracking pixels, online experimentation, machine learning, and “agile” product cycles. YouTube’s algorithm was measuring what kept viewers there the longest, not what they wanted to see, and feeding them more of the same.

Modeling 190

Modeling Advertising Recreation/Entertainment Metrics 190