Data Science and Beyond

APRIL 5, 2021

I previously posted about my experiences with RLS offline data collection and visualisation of the collected data , and have since helped with quite a few RLS surveys. My main "day job" focus in 2020 was on being the tech lead for Automattic’s new experimentation platform (ExPlat). Technical work.

Experimentation 61

Experimentation Testing Publishing Measurement 61

Occam's Razor

APRIL 8, 2013

We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. Testing out a new feature.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. As data science work is experimental and probabilistic in nature, data scientists are often faced with making inferences.

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

Occam's Razor

JUNE 6, 2007

Bonus: Interactive CD: Contains six podcasts, one video, two web analytics metrics definitions documents and five insightful powerpoint presentations. Experimentation & Testing (A/B, Multivariate, you name it). What ideas to test first on your site? It is a book about Web Analytics 2.0. Qualitative and quantitative.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Yet, this challenge is not insurmountable. for what is and isn’t possible) to address these challenges. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110

Domino Data Lab

MAY 8, 2019

In contrast, some researchers who are exploring the definitions, possibilities, and limitations of model interpretation point toward more comprehensive views. For example, common practices for collecting data to build training datasets tend to throw away valuable information along the way. . Let’s look through some antidotes.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105