O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

CIO Business Intelligence

MARCH 5, 2024

Many other platforms, such as Coveo’s Relative Generative Answering , Quickbase AI , and LaunchDarkly’s Product Experimentation , have embedded virtual assistant capabilities but don’t brand them copilots. They advertise a feature where you can follow a meeting, and then Copilot will join and take notes for you.”

Cost-Benefit 115

Cost-Benefit Advertising Experimentation Software 115

Occam's Razor

JULY 6, 2016

Yes, I worry that Analysts, and Marketers, are spending too much time with their head buried in custom reports and advance segments and smart calculated metrics and strategic or tactical dashboards. Lab usability testing and online surveys both provide great strategies to obsess about user centric design. Thanks. [ /sidebar ].

Testing 86

Testing Marketing Experimentation Cost-Benefit 86

Occam's Razor

SEPTEMBER 15, 2014

Nothing I can tell you about the importance of having an incredible mobile strategy will surprise you. If you look at the mobile marketing strategies, you will see they don't reflect this shift to mobile. Create a distinct mobile website and mobile app measurement strategies. Media-Mix Modeling/Experimentation.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

FEBRUARY 28, 2017

To ensure customer delight was delivered in a timely manner, it was also decided that Average Call Time (ACT) would now be The success metric. The success metric, ACT, did go down. That ACT was an activity metric was terrible – if you have a The success metric, it should always be an outcome metric. Another issue.

Key Performance Indicator 106

Key Performance Indicator Metrics Measurement Advertising 106

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Another pattern that I’ve seen in good PMs is that they’re very metric-driven.

Management 110

Management Machine Learning Experimentation Metrics 110

The Unofficial Google Data Science Blog

JUNE 30, 2016

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. Your company has recently launched a new pickup truck, along with the corresponding online advertisement campaign. For example, imagine that you are working for a car manufacturer.

Statistics 44

Statistics Optimization Modeling Experimentation 44

The Unofficial Google Data Science Blog

APRIL 16, 2019

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime. Such decisions involve an actual hypothesis test on specific metrics (e.g.

Experimentation 68

Experimentation Sales Metrics Measurement 68

Occam's Razor

MAY 27, 2015

In a recent set of keynotes and consulting engagements in the US, UK and Canada, I've had an overwhelming feeling that in very fundamental ways some companies make imprecise choices when it comes to their digital strategy. A data-first strategy is a winning formula. Programmatic advertising is all the rage. The web is dead.

Marketing Analytics 153

Marketing Analytics Marketing Analytics Advertising 153

Occam's Razor

SEPTEMBER 30, 2013

We'll start with digital at the highest strategic level, which leads us into content marketing, from there it is a quick hop over to the challenge of metrics and silos, followed by a recommendation to optimize for the global maxima, and we end with the last two visuals that cover social investment and social content strategy.

Marketing Analytics 154

Marketing Analytics Marketing Visualization Analytics 154

Occam's Razor

DECEMBER 12, 2016

How do you ensure that your can zig-zag with business strategy? " I think the answer expected was my view related to the size of the company or their industries or those that might have Google Analytics or those with big advertising spends etc. Macro & Micro Outcomes Content/Strategy. " That lead to this post.

Analytics 141

Analytics Data-driven Strategy Consulting 141

Occam's Razor

AUGUST 13, 2012

That means: All of these metrics are off. If your wish in the second part is to track effectiveness of advertising ( how to determine ROI ) then please see this post: Measuring Incrementality: Controlled Experiments to the Rescue! This is exactly why the Page Value metric (in the past called $index value) was created.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

Occam's Razor

JANUARY 9, 2012

A huge part of the last few years for me have been about bringing more data, better strategies, more powerful tools, ever more impactful keynotes to people around the world. Get the senior-most people in the largest companies in the world to unlock their imaginations when it comes to their digital existence via impactful digital strategies.

Marketing 140

Marketing B2B Measurement Risk 140

Occam's Razor

OCTOBER 19, 2010

Depending on the size of your company (translation: resources available and what's impactful and doable) here is the priority order that I recommend for you to execute your web analytics tools strategy right. Mongoose Metrics ~ ifbyphone. Experimentation and Testing Tools [The "Why" – Part 1].

Analytics 135

Analytics Testing Measurement Optimization 135

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. They’re about having the mindset of an experimenter and being willing to let data guide a company’s decision-making process.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

Occam's Razor

APRIL 29, 2013

Many used some data, but they unfortunately used silly data strategies/metrics. And silly simply because as soon as the strategy/success metric being obsessed about was mentioned, it was clear they would fail. That is a cheaper systems/platform/data strategy. It is a really good metric. I love bounce rate.

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

NOVEMBER 2, 2015

" The second question was never answered either, but because all businesses know is how to pimp that became their default strategy. if yes, what should your content (and marketing) strategy be. Success Metrics. In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

Occam's Razor

MARCH 7, 2016

Why evolve the strategy now? Some recent events made me wonder what the best strategy for a business is. And then, as Google evolves its strategy from it's own point of view, one result was a tweak to it's algorithm. I'm creating a strategy to diversify both platforms and audience relationship quality.

Marketing Analytics 86

Marketing Analytics Marketing Analytics KPI 86

Sisense

NOVEMBER 23, 2020

Marketing needs quantitative metrics to justify every dollar they’re spending, the return they’re getting, and the revenue generated, so it’s one of the best examples of why you need a data-driven, evidence-based decision making culture within an organization,” he explains. “For

Analytics 98

Analytics Data-driven Marketing Reporting 98