O'Reilly on Data

MARCH 31, 2020

Because it’s so different from traditional software development, where the risks are more or less well-known and predictable, AI rewards people and companies that are willing to take intelligent risks, and that have (or can develop) an experimental culture. Measurement, tracking, and logging is less of a priority in enterprise software.

Management 332

Management Machine Learning Experimentation Metrics 332

CIO Business Intelligence

JUNE 28, 2023

Experimentation with a use case driven approach. For those companies that have chosen to experiment, they’re doing so largely in a controlled sandbox environment, with an emphasis on learning and understanding how to pair the technology with human capabilities to optimize for value and risk. Looking forward.

Enterprise 52

Enterprise Experimentation Risk Data-driven 52

Occam's Razor

NOVEMBER 12, 2006

Mostly because short term goals drive a lot of what we do and if you are selling something on your website then it only seems to make logical sense that we measure conversion rate and get it up as high as we can as fast as we can. So measure Bounce Rate of your website. Even though we should not obsess about conversion rate we do.

Measurement 99

Measurement Analytics Optimization Marketing 99

Cloudera

MARCH 2, 2022

You can read previous blog posts on Impala’s performance and querying techniques here – “ New Multithreading Model for Apache Impala ”, “ Keeping Small Queries Fast – Short query optimizations in Apache Impala ” and “ Faster Performance for Selective Queries ”. . It also measured peak memory consumed at the node and the operator level.

Data Warehouse 86

Data Warehouse Optimization Analytics Sales 86

Occam's Razor

JULY 24, 2018

To name a few: Digital Marketing & Measurement Model | Analytics Ecosystem | Web Analytics 2.0. During a discussion around planning for measurement, a peer was struggling with a unique collection of challenges. You see more digital metrics because digital is more measurable. The ability to optimize landing pages.

Analytics 93

Analytics Metrics Strategy Measurement 93

Occam's Razor

AUGUST 22, 2011

Key To Your Digital Success: Web Analytics Measurement Model. " Measuring Incrementality: Controlled Experiments to the Rescue! Barriers To An Effective Web Measurement Strategy [+ Solutions!]. Measuring Online Engagement: What Role Does Web Analytics Play? "Engagement" How Do I Measure Success?

KPI 124

KPI Metrics Measurement ROI 124

Insight

APRIL 28, 2020

How will they interact with product, engineering, sales, or marketing? provide an opportunity to measure both. When their favorite candidates are hired out from underneath them, they graduate to making the second mistake of optimizing for speed and stop screening candidates altogether. Will they be a strategic thought partner?

Data-driven 53

Data-driven Data Science Experimentation Measurement 53

Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. As data science work is experimental and probabilistic in nature, data scientists are often faced with making inferences.

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

CIO Business Intelligence

MAY 1, 2024

Pilots can offer value beyond just experimentation, of course. McKinsey reports that industrial design teams using LLM-powered summaries of user research and AI-generated images for ideation and experimentation sometimes see a reduction upward of 70% in product development cycle times. What are you measuring?

Cost-Benefit 143

Cost-Benefit Metrics Insurance Measurement 143

The Unofficial Google Data Science Blog

JULY 22, 2020

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. When there are changing assignment weights and time-based confounders, this complication must be considered either in the analysis or the experimental design.

Experimentation 95

Experimentation Statistics Testing Strategy 95

datapine

FEBRUARY 4, 2020

Be it in marketing, or in sales, finance or for executives, reports are essential to assess your activity and evaluate the results. Management thinker Peter Drucker once stated, “if you can’t measure it, you can’t improve it” – and he couldn’t be more right. To know if you are successful, you first need to define success and track it.

Reporting 280

Reporting Marketing Advertising Metrics 280

The Unofficial Google Data Science Blog

JUNE 30, 2016

In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects. You are in charge of assessing whether the campaign had an impact on sales. It should be noted that inverse probability weighting is not generally optimal (i.e.,

Statistics 44

Statistics Optimization Modeling Experimentation 44

Cloudera

APRIL 26, 2023

These include data recovery service, quota management, node harvesting, optimizing TCO, and more. Better innovation , first by enabling end users to adopt new features faster for better insights, and second, by allowing developers to run experimental workloads without risking production stability, fostering a culture of innovation.

Cost-Benefit 63

Cost-Benefit Optimization Experimentation Machine Learning 63

The Unofficial Google Data Science Blog

APRIL 16, 2019

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime. But these are not usually amenable to A/B experimentation.

Experimentation 68

Experimentation Sales Metrics Measurement 68

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). What's the optimal organization structure (and who should own web analytics!)? There are four important factors that might work against lots of sales of this book. It is a book about Web Analytics 2.0. Qualitative and quantitative. Clicks and outcomes.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Occam's Razor

JULY 18, 2011

To not have it as an active part of your marketing portfolio is sub-optimal. The message, the customer data, the ability to reach current and prospective customers, drive new sales as well as repeat sales, experiment with new ideas and offers, and so much more. Optimal Acquisition Email Metrics. Every fiber of your being.

Metrics 137

Metrics Marketing Measurement Cost-Benefit 137

Occam's Razor

FEBRUARY 28, 2017

The qualitative surveys measuring unhappiness went down even more than before. You are what you measure. Additionally, I passionately believe that optimal metrics help solve for more than an individual’s behavior. While not optimal, it was understandable given the evolutionary stage they were at. It is not easy.

Key Performance Indicator 106

Key Performance Indicator Metrics Measurement Advertising 106

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. These measurement-obsessed companies have an advantage when it comes to AI.

Management 110

Management Machine Learning Experimentation Metrics 110

Occam's Razor

DECEMBER 12, 2016

Digital Marketing & Measurement Model. My solution to this, incredibly real and frustrating problem, is to insist on seeing the signed in blood version of the company's Digital Marketing & Measurement Model. What one critical metric will help you clearly measure performance for each strategy above? That's it.

Analytics 141

Analytics Data-driven Strategy Consulting 141

Occam's Razor

JULY 1, 2008

3 ] Provide you with a bushel of specific multichannel measurement ideas to help quantify the offline impact of your online presence. Why should you care about measuring multichannel impact? There are many jobs your website is doing, it is your job to measure the holistic impact. Bonus Tip : But don't stop there.

Analytics 116

Analytics Measurement Marketing Sales 116

Occam's Razor

MARCH 23, 2010

My problem with these mistruths and FUD is that they result in a ton of practitioners and companies making profoundly sub optimal choices, which in turn results in not just much longer slogs but also spectacular career implosions and the entire web analytics industry suffering. This is sad. Even a little frustrating. Likely not.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

JULY 26, 2010

If today you are a content site that is only focused on measuring content consumed try to go deeper to understanding CPA of the ads or Visitor Loyalty. 3: Measure complete site success. Measure everyone's success. But donations is just one measure of success (" macro conversion "). So why not measure those?

Metrics 96

Metrics Measurement Dashboards Reporting 96

Occam's Razor

SEPTEMBER 30, 2013

Each of the six visuals re-frames a unique facet of the digital opportunity/challenge, and shares how to optimally take advantage of the opportunity/challenge. It is also immensely beneficial for search engine optimization (great content, delivered fresh, every day!). Then that is all they optimize for. And so on and so forth.

Marketing Analytics 154

Marketing Analytics Marketing Visualization Analytics 154

Occam's Razor

FEBRUARY 7, 2011

Nilaye Thakrar: What is the best way to attribute an offline sale to an online assist? Brian Krick: Best way to measure and communicate "available demand" from available channels (social, search, display) for forecast modeling. Additionally, it is exceptionally difficult to measure available demand because 1.

Analytics 94

Analytics Measurement Metrics Predictive Analytics 94

Occam's Razor

MAY 18, 2010

And as recently as two weeks ago I stressed the importance of effective segmentation as the cornerstone of the Web Analytics Measurement Framework. Key elements of the Web Analytics Measurement Framework.]. Acquisition also includes search engine optimization (SEO), because it is an activity on which you spend time and money.

Analytics 123

Analytics Key Performance Indicator Metrics Measurement 123

Occam's Razor

MAY 27, 2015

Here are the digital myths that are leading us down a profoundly sub-optimal path: 1. Per our friends at Wikipedia, Programmatic encompasses an array of technologies that automate the buying, placement and optimization of media inventory. In large measure that is because of the rise of programmatic buying. The web is dead.

Marketing Analytics 153

Marketing Analytics Marketing Analytics Advertising 153

Occam's Razor

FEBRUARY 8, 2021

From observing behavior closely, and from my own experimentation and failure, I've noticed consistent patterns in what great employees do and great bosses do. They are there to nudge your career in an optimal direction. I work in Marketing, I can take on a project in Sales or HR or Engineering. It is rejuvenating.

Strategy 132

Strategy Statistics Cost-Benefit Marketing 132

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. They’re about having the mindset of an experimenter and being willing to let data guide a company’s decision-making process. The results?

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

We data scientists now have access to tools that allow us to run a large numbers of experiments, and then to slice experimental populations by any combination of dimensions collected. Make experimentation cheap and understand the cost of bad decisions. This leads to the proliferation of post hoc hypotheses. What is to be done?

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

NOVEMBER 2, 2015

For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). Measure all this Social Media activity.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

Occam's Razor

APRIL 29, 2013

You measure bounce rate and you can find those things, then figure out if the problem is at the source (ads) or destination (your site). By lowering your bounce rate all you managed to accomplish is get your ads created and targeted properly and optimize the landing pages. Because Likes (and +1s, Followers) measure a fleeting Hello.

Marketing 166

Marketing Metrics Advertising Measurement 166

Sisense

NOVEMBER 23, 2020

This is particularly relevant when looking for new opportunities and new growth, which requires looking at optimizations not needed in the past. This all contributes to a culture of innovation, experimentation, and exploration. Scott explains this is both a challenge and an opportunity. The changing role of the data professional.

Analytics 98

Analytics Data-driven Marketing Reporting 98