Remove Experimentation Remove Key Performance Indicator Remove Metrics Remove Uncertainty
article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

To win in business you need to follow this process: Metrics > Hypothesis > Experiment > Act. We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. That metric is tied to a KPI.

Metrics 156
article thumbnail

AI Product Management After Deployment

O'Reilly on Data

Ideally, AI PMs would steer development teams to incorporate I/O validation into the initial build of the production system, along with the instrumentation needed to monitor model accuracy and other technical performance metrics. For models, this means monitoring their performance and the equity of their predictions.”.