Rocket-Powered Data Science

FEBRUARY 15, 2023

Those F’s are: Fragility, Friction, and FUD (Fear, Uncertainty, Doubt). These changes may include requirements drift, data drift, model drift, or concept drift. encouraging and rewarding) a culture of experimentation across the organization. Test early and often. Test and refine the chatbot. Launch the chatbot.

Strategy 289

Strategy Experimentation Uncertainty Machine Learning 289

Domino Data Lab

MAY 15, 2019

This Domino Data Science Field Note covers Pete Skomoroch ’s recent Strata London talk. Pete indicates, in both his November 2018 and Strata London talks, that ML requires a more experimental approach than traditional software engineering. These steps also reflect the experimental nature of ML product management.

Machine Learning 111

Machine Learning Management Experimentation Uncertainty 111

The Unofficial Google Data Science Blog

APRIL 23, 2024

Crucially, it takes into account the uncertainty inherent in our experiments. Experiments, Parameters and Models At Youtube, the relationships between system parameters and metrics often seem simple — straight-line models sometimes fit our data well. It is a big picture approach, worthy of your consideration.

Experimentation 52

Experimentation Optimization Uncertainty Metrics 52

The Unofficial Google Data Science Blog

DECEMBER 14, 2021

by AMIR NAJMI & MUKUND SUNDARARAJAN Data science is about decision making under uncertainty. Some of that uncertainty is the result of statistical inference, i.e., using a finite sample of observations for estimation. But there are other kinds of uncertainty, at least as important, that are not statistical in nature.

Uncertainty 56

Uncertainty Statistics Measurement Cost-Benefit 56

The Unofficial Google Data Science Blog

JANUARY 14, 2016

by AMIR NAJMI Running live experiments on large-scale online services (LSOS) is an important aspect of data science. We must therefore maintain statistical rigor in quantifying experimental uncertainty. In this post we explore how and why we can be “ data-rich but information-poor ”.

Experimentation 41

Experimentation Statistics Metrics Measurement 41

IBM Big Data Hub

APRIL 18, 2024

While leaders have some reservations about the benefits of current AI, organizations are actively investing in gen AI deployment, significantly increasing budgets, expanding use cases, and transitioning projects from experimentation to production. The AGI would need to handle uncertainty and make decisions with incomplete information.

Cost-Benefit 97

Cost-Benefit Modeling Manufacturing Interactive 97

The Unofficial Google Data Science Blog

JULY 22, 2020

Another reason to use ramp-up is to test if a website's infrastructure can handle deploying a new arm to all of its users. The website wants to make sure they have the infrastructure to handle the feature while testing if engagement increases enough to justify the infrastructure. We offer two examples where this may be the case.

Experimentation 95

Experimentation Statistics Testing Strategy 95