Domino Data Lab

MAY 15, 2019

Pete indicates, in both his November 2018 and Strata London talks, that ML requires a more experimental approach than traditional software engineering. It is more experimental because it is “an approach that involves learning from data instead of programmatically following a set of human rules.”

Machine Learning 111

Machine Learning Management Experimentation Uncertainty 111

O'Reilly on Data

MARCH 31, 2020

The model outputs produced by the same code will vary with changes to things like the size of the training data (number of labeled examples), network training parameters, and training run time. This has serious implications for software testing, versioning, deployment, and other core development processes.

Management 332

Management Machine Learning Experimentation Metrics 332

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. And then you’ll do a lot of work to get it out and then there’ll be no ROI at the end.

Management 110

Management Machine Learning Experimentation Metrics 110

Domino Data Lab

MAY 8, 2019

The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. Instead, consider a “full stack” tracing from the point of data collection all the way out through inference. Keep in mind that data science is fundamentally interdisciplinary. Let’s look through some antidotes.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

MARCH 23, 2010

Having two tools guarantees you are going to be data collection, data processing and data reconciliation organization. If you blog that a short on-exit survey or a feedback button is a great way to collect voice of customer, I don't have to be lazy or hyper paranoid and wait for a convincing case study.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

AUGUST 13, 2012

Bjoern Sjut3: My main issue at the moment: How will multi-channel funnels and ROI calculations work in a multi device world? If your wish in the second part is to track effectiveness of advertising ( how to determine ROI ) then please see this post: Measuring Incrementality: Controlled Experiments to the Rescue! That is the solution.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

Occam's Razor

OCTOBER 19, 2010

If after rigorous analysis you have determined that you have evolved to a stage that you need a data warehouse then you are out of luck with Yahoo! If you can show ROI on a DW it would be a good use of your money to go with Omniture Discover, WebTrends Data Mart, Coremetrics Explore. Five Reasons And Awesome Testing Ideas.

Analytics 135

Analytics Testing Measurement Optimization 135