article thumbnail

Explaining black-box models using attribute importance, PDPs, and LIME

Domino Data Lab

The interest in interpretation of machine learning has been rapidly accelerating in the last decade. This can be attributed to the popularity that machine learning algorithms, and more specifically deep learning, has been gaining in various domains. Methods for explaining Deep Learning.

Modeling 139
article thumbnail

Adding Common Sense to Machine Learning with TensorFlow Lattice

The Unofficial Google Data Science Blog

If we observe label vector y and feature vectors $x_1, cdots, x_d$ we can write the differentiable empirical risk minimization problem with a squared loss as$$ min_theta left| y - sum_{j=1}^d c_j(x_j) right|^2 $$Note that we use squared loss for the simplicity of presentation; one can use any differentiable loss in their application.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Themes and Conferences per Pacoid, Episode 9

Domino Data Lab

That’s a risk in case, say, legislators – who don’t understand the nuances of machine learning – attempt to define a single meaning of the word interpret. For example, in the case of more recent deep learning work, a complete explanation might be possible: it might also entail an incomprehensible number of parameters.

article thumbnail

Credit Card Fraud Detection using XGBoost, SMOTE, and threshold moving

Domino Data Lab

Rules-based fraud detection (top) vs. classification decision tree-based detection (bottom): The risk scoring in the former model is calculated using policy-based, manually crafted rules and their corresponding weights. deep learning) there is no guaranteed explainability. Learning from Imbalanced Data. Hall, and W.

article thumbnail

Data Science at The New York Times

Domino Data Lab

When he retired in 2009 he had some time on his hands. You can sleep at night as a data scientician and you know you’re not building a random number generator, but the people from product, they don’t want to know just that you can predict who’s going to be at risk. Please help us make sense of it.”