O'Reilly on Data

JULY 28, 2020

Product Managers are responsible for the successful development, testing, release, and adoption of a product, and for leading the team that implements those milestones. Without clarity in metrics, it’s impossible to do meaningful experimentation. Ongoing monitoring of critical metrics is yet another form of experimentation.

Marketing 363

Marketing Experimentation Metrics Testing 363

O'Reilly on Data

MARCH 31, 2020

The model outputs produced by the same code will vary with changes to things like the size of the training data (number of labeled examples), network training parameters, and training run time. This has serious implications for software testing, versioning, deployment, and other core development processes.

Management 339

Management Machine Learning Experimentation Metrics 339

DataKitchen

APRIL 13, 2021

Testing and Data Observability. We have also included vendors for the specific use cases of ModelOps, MLOps, DataGovOps and DataSecOps which apply DataOps principles to machine learning, AI, data governance, and data security operations. . Genie — Distributed big data orchestration service by Netflix.

Testing 300

Testing Machine Learning Consulting Data Quality 300

Domino Data Lab

JUNE 23, 2019

Pete Skomoroch ’s “ Product Management for AI ”session at Rev provided a “crash course” on what product managers and leaders need to know about shipping machine learning (ML) projects and how to navigate key challenges. Be aware that machine learning often involves working on something that isn’t guaranteed to work. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110