O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

datapine

FEBRUARY 4, 2020

Management thinker Peter Drucker once stated, “if you can’t measure it, you can’t improve it” – and he couldn’t be more right. Our final monthly report is providing a good overview of the performance of all your paid advertisement campaigns. 3) Online Advertising Performance. 2) Marketing Performance Report. click to enlarge**.

Reporting 280

Reporting Marketing Advertising Metrics 280

The Unofficial Google Data Science Blog

MAY 31, 2016

However, it is generally not possible to determine the incremental impact of advertising by merely observing such data across time. One approach that Google has long used to obtain causal estimates of the impact of advertising is geo experiments. It is important that we can measure the effect of these offline conversions as well.

Advertising 42

Advertising Testing Sales Statistics 42

The Unofficial Google Data Science Blog

JUNE 30, 2016

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. Your company has recently launched a new pickup truck, along with the corresponding online advertisement campaign. For example, imagine that you are working for a car manufacturer.

Statistics 44

Statistics Optimization Modeling Experimentation 44

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. These measurement-obsessed companies have an advantage when it comes to AI. It is similar to R&D.

Management 110

Management Machine Learning Experimentation Metrics 110

The Unofficial Google Data Science Blog

APRIL 16, 2019

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime. Such decisions involve an actual hypothesis test on specific metrics (e.g.

Experimentation 68

Experimentation Sales Metrics Measurement 68

Occam's Razor

AUGUST 12, 2013

MCA-O2S covers the challenge of attributing the offline impact (revenue/brand value/butts in seats/phone calls/etc) driven by online marketing and advertising. MCA-AMS covers the challenge of attributing accurate impact of our marketing and advertising efforts across multiple devices (desktop, laptop, mobile, TV). Or we could not.)

Modeling 161

Modeling Optimization Marketing Interactive 161

Domino Data Lab

MAY 8, 2019

Visualizations are vital in data science work, with the caveat that the information that they convey may be 4-5 layers of abstraction away from the actual business process being measured. measure the subjects’ ability to trust the models’ results. Information can get quite distorted after being abstracted that many times.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

SEPTEMBER 15, 2014

A majority of YouTube consumption is on mobile, yet if there is an advertising or content strategy inside a company for YouTube it rarely accommodates for this reality. But why blame others, in this post let's focus on one important reason whose responsibility can be squarely put on your shoulders and mine: Measurement.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

AUGUST 13, 2012

Yehoshua Coren: Best ways to measure user behavior in a multi-touch, multi-device digital world. What's possible to measure. What's not possible to measure. We all have smart phones, laptops, tablets and soon Smart TVs – but most of our measurements are usually done in Cookies that are device/browser specific.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

Occam's Razor

OCTOBER 19, 2010

If you have evolved to a stage that you need behavior targeting then get Omniture Test and Target or Sitespect. You'll measure Task Completion Rate in 4Q (below). You'll measure Share of Search using Insights for Search (below). Experimentation and Testing Tools [The "Why" – Part 1].

Analytics 135

Analytics Testing Measurement Optimization 135

Occam's Razor

JANUARY 9, 2012

Most companies are astonishingly blasé about data and possibilities of measurement. " Sad, unimaginative measurements of their sad, unimaginative campaigns. But you can probably find 1000 people *relevant* to your brand and message by advertising on 28 *relevant* channels in the long tail (those after channel #14).

Marketing 140

Marketing B2B Measurement Risk 140

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated. The results?

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

CIO Business Intelligence

MAY 20, 2024

He tested this hypothesis by having some machines at the facility warm up and others not. Another study used smartphone geolocation data to measure face-to-face interactions among workers at various Silicon Valley firms. As a means of control, budgets measure performance against planned targets, influencing employee behavior.

Management 111

Management Interactive Measurement Marketing 111

Occam's Razor

NOVEMBER 2, 2015

Higher Order Bits: Human vs. Business, Success KPIs, S-T-D-C Framework, MoR Test. For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. It covers, content, marketing and measurement. It is pronounced the more test.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

Occam's Razor

APRIL 29, 2013

You measure bounce rate and you can find those things, then figure out if the problem is at the source (ads) or destination (your site). Because Likes (and +1s, Followers) measure a fleeting Hello. PS: Bonus : Facebook Advertising / Marketing: Best Metrics, ROI, Business Value. Bad ad creatives. Horrible landing pages.

Marketing 166

Marketing Metrics Advertising Measurement 166