O'Reilly on Data

JULY 28, 2020

Without clarity in metrics, it’s impossible to do meaningful experimentation. Experiments allow AI PMs not only to test assumptions about the relevance and functionality of AI Products, but also to understand the effect (if any) of AI products on the business. Don’t expect agreement to come simply.

Marketing 362

Marketing Experimentation Metrics Testing 362

IBM Big Data Hub

MAY 17, 2024

Business leaders worldwide are asking their teams the same question: “Are we using the cloud effectively?” ” Given the statistics—82% of surveyed respondents in a 2023 Statista study cited managing cloud spend as a significant challenge—it’s a legitimate concern.

Modeling 94

Modeling Cost-Benefit Optimization Digital Transformation 94

CIO Business Intelligence

JANUARY 2, 2024

He plans to scale his company’s experimental generative AI initiatives “and evolve into an AI-native enterprise” in 2024. This vision represents a fundamental shift, positioning AI as an integral part of our business fabric rather than just an add-on. “AI But at the end of the day, it boils down to statistics.

IT 144

IT Cost-Benefit Statistics Consulting 144

Occam's Razor

MAY 22, 2006

This post is a primer on the delightful world of testing and experimentation (A/B, Multivariate, and a new term from me: Experience Testing). Experimentation and testing help us figure out we are wrong, quickly and repeatedly and if you think about it that is a great thing for our customers, and for our employers. Counter claims?

Experimentation 103

Experimentation Testing Optimization Measurement 103

CIO Business Intelligence

JUNE 28, 2023

As Belcorp considered the difficulties it faced, the R&D division noted it could significantly expedite time-to-market and increase productivity in its product development process if it could shorten the timeframes of the experimental and testing phases in the R&D labs.

Digital Transformation 92

Digital Transformation Cost-Benefit Informatics Data mining 92

The Unofficial Google Data Science Blog

JANUARY 14, 2016

Unlike experimentation in some other areas, LSOS experiments present a surprising challenge to statisticians — even though we operate in the realm of “big data”, the statistical uncertainty in our experiments can be substantial. We must therefore maintain statistical rigor in quantifying experimental uncertainty.

Experimentation 41

Experimentation Statistics Metrics Measurement 41