article thumbnail

Unlocking the Power of Better Data Science Workflows

Smart Data Collective

Phase 4: Knowledge Discovery. Algorithms can also be tested to come up with ideal outcomes and possibilities. When these two elements are in harmony, there are fewer delays and less risk of data corruption. Finally, models are developed to explain the data. Make the Workflow Obvious and Apparent to Others.

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

One reason to do ramp-up is to mitigate the risk of never before seen arms. A ramp-up strategy may mitigate the risk of upsetting the site’s loyal users who perhaps have strong preferences for the current statistics that are shown. For example, imagine a fantasy football site is considering displaying advanced player statistics.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Explaining black-box models using attribute importance, PDPs, and LIME

Domino Data Lab

This dataset classifies customers based on a set of attributes into two credit risk groups – good or bad. After forming the X and y variables, we split the data into training and test sets. This is to be expected, as there is no reason for a perfect 50:50 separation of the good vs. bad credit risk. show_in_notebook().

Modeling 139
article thumbnail

ML internals: Synthetic Minority Oversampling (SMOTE) Technique

Domino Data Lab

Their tests are performed using C4.5-generated This carries the risk of this modification performing worse than simpler approaches like majority under-sampling. note that this variant “performs worse than plain under-sampling based on AUC” when tested on the Adult dataset (Dua & Graff, 2017). Chawla et al., Chawla et al.

article thumbnail

AI, the Power of Knowledge and the Future Ahead: An Interview with Head of Ontotext’s R&I Milena Yankova

Ontotext

Milena Yankova : Our work is focused on helping companies make sense of their own knowledge. Within a large enterprise, there is a huge amount of data accumulated over the years – many decisions have been made and different methods have been tested. Some of this knowledge is locked and the company cannot access it.

article thumbnail

Using Empirical Bayes to approximate posteriors for large "black box" estimators

The Unofficial Google Data Science Blog

One way to check $f_theta$ is to gather test data and check whether the model fits the relationship between training and test data. This tests the model’s ability to distinguish what is common for each item between the two data sets (the underlying $theta$) and what is different (the draw from $f_theta$).

KDD 40
article thumbnail

Variance and significance in large-scale online services

The Unofficial Google Data Science Blog

For this purpose, let’s assume we use a t-test for difference between group means. Effect size thus defined is useful because the statistical power of a classical test for $delta$ being non-zero depends on $e/sqrt{tilde{n}}$, where $tilde{n}$ is the harmonic mean of sample sizes of the two groups being compared.