Remove Data Collection Remove Data Quality Remove Metrics Remove Uncertainty
article thumbnail

What you need to know about product management for AI

O'Reilly on Data

Machine learning adds uncertainty. Underneath this uncertainty lies further uncertainty in the development process itself. There are strategies for dealing with all of this uncertainty–starting with the proverb from the early days of Agile: “ do the simplest thing that could possibly work.”

article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

Once we’ve answered that, we will then define and use metrics to understand the quality of human-labeled data, along with a measurement framework that we call Cross-replication Reliability or xRR. Last, we’ll provide a case study of how xRR can be used to measure improvements in a data-labeling platform.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Product Management for AI

Domino Data Lab

Companies with successful ML projects are often companies that already have an experimental culture in place as well as analytics that enable them to learn from data. Ensure that product managers work on projects that matter to the business and/or are aligned to strategic company metrics. That’s another pattern.

article thumbnail

Human-centered design and data-driven insights elevate precision in government IT modernization

IBM Big Data Hub

Government executives face several uncertainties as they embark on their journeys of modernization. A pain point tracker (a repository of business, human-centered design and technology issues that inhibit users’ ability to execute critical tasks) captures themes that arise during the data collection process.

article thumbnail

Data Science, Past & Future

Domino Data Lab

One is data quality, cleaning up data, the lack of labelled data. You know, typically, when you think about running projects, running teams, in terms of setting the priorities for projects, in terms of describing, what are the key metrics for success for a project, that usually falls on product management.