O'Reilly on Data

JULY 28, 2020

Without clarity in metrics, it’s impossible to do meaningful experimentation. AI PMs must ensure that experimentation occurs during three phases of the product lifecycle: Phase 1: Concept During the concept phase, it’s important to determine if it’s even possible for an AI product “ intervention ” to move an upstream business metric.

Marketing 362

Marketing Experimentation Metrics Testing 362

O'Reilly on Data

MARCH 31, 2020

All you need to know for now is that machine learning uses statistical techniques to give computer systems the ability to “learn” by being trained on existing data. After training, the system can make predictions (or deliver other results) based on data it hasn’t seen before. Machine learning adds uncertainty.

Management 332

Management Machine Learning Experimentation Metrics 332

O'Reilly on Data

MARCH 18, 2020

It seems as if the experimental AI projects of 2019 have borne fruit. By contrast, AI adopters are about one-third more likely to cite problems with missing or inconsistent data. The logic in this case partakes of garbage-in, garbage out : data scientists and ML engineers need quality data to train their models.

Enterprise 311

Enterprise Deep Learning Data Governance Risk 311

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. The biggest time sink is often around data collection, labeling and cleaning.

Management 110

Management Machine Learning Experimentation Metrics 110