The Unofficial Google Data Science Blog

JANUARY 14, 2016

And an LSOS is awash in data, right? Well, it turns out that depending on what it cares to measure, an LSOS might not have enough data. The practical consequence of this is that we can’t afford to be sloppy about measuring statistical significance and confidence intervals.

Experimentation 41

Experimentation Statistics Metrics Measurement 41

The Unofficial Google Data Science Blog

JULY 22, 2020

One reason to do ramp-up is to mitigate the risk of never before seen arms. A ramp-up strategy may mitigate the risk of upsetting the site’s loyal users who perhaps have strong preferences for the current statistics that are shown. For example, imagine a fantasy football site is considering displaying advanced player statistics.

Experimentation 95

Experimentation Statistics Testing Strategy 95

Domino Data Lab

MAY 20, 2021

Working with highly imbalanced data can be problematic in several aspects: Distorted performance metrics — In a highly imbalanced dataset, say a binary dataset with a class ratio of 98:2, an algorithm that always predicts the majority class and completely ignores the minority class will still be 98% correct. Chawla et al. link] Fisher, R.

Machine Learning 136

Machine Learning Metrics Data mining Knowledge Discovery 136

The Unofficial Google Data Science Blog

NOVEMBER 4, 2015

Posteriors are useful to understand the system, measure accuracy, and make better decisions. Methods like the Poisson bootstrap can help us measure the variability of $t$, but don’t give us posteriors either, particularly since good high-dimensional estimators aren’t unbiased.

KDD 40

KDD Testing Machine Learning Modeling 40

Domino Data Lab

AUGUST 1, 2021

For this demo we’ll use the freely available Statlog (German Credit Data) Data Set, which can be downloaded from Kaggle. This dataset classifies customers based on a set of attributes into two credit risk groups – good or bad. Conference on Knowledge Discovery and Data Mining, pp.

Modeling 139

Modeling Deep Learning Machine Learning Knowledge Discovery 139