Remove Experimentation Remove Key Performance Indicator Remove Reporting Remove Uncertainty
article thumbnail

AI Product Management After Deployment

O'Reilly on Data

To support verification in these areas, a product manager must first ensure that the AI system is capable of reporting back to the product team about its performance and usefulness over time. Returning to previous anti-bias and AI transparency tools such as Model Cards for Model Reporting (Timnit Gebru, et al.)

article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. They might deal with uncertainty, but they're not random. Online, offline or nonline. Yet this structure rarely exists in companies.

Metrics 156