Data Science and Beyond

APRIL 5, 2021

The world has adapted quickly, though it seems like Automattic’s globally-distributed model is still quite unusual. Instead, many companies have switched to a locally-remote model, hiring remotely within the same country or timezone region. Only time will tell. Sustainability.

Experimentation 61

Experimentation Testing Publishing Measurement 61

Dataiku

APRIL 22, 2022

It’s no secret that training AI models is an energy-intensive and large dataset-dependent endeavor and, to corroborate this, researchers at the University of Massachusetts Amherst performed a lifecycle assessment on large, widely accepted AI models trained on the vast datasets needed to achieve accuracy. Today, in 2022, the code (i.e.,

Experimentation 59

Experimentation Modeling Business Objectives Manufacturing 59

Occam's Razor

APRIL 8, 2013

We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. Testing out a new feature.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. As data science work is experimental and probabilistic in nature, data scientists are often faced with making inferences.

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

AWS Big Data

JULY 3, 2023

Look – ahead bias – This is a common challenge in backtesting, which occurs when future information is inadvertently included in historical data used to test a trading strategy, leading to overly optimistic results. To comply with licensing considerations, we cannot provide a sample of the ETF constituents data.

Snapshot 83

Snapshot Data Lake Testing Strategy 83

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Yet, this challenge is not insurmountable. for what is and isn’t possible) to address these challenges. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110

Domino Data Lab

MAY 8, 2019

Paco Nathan’s latest article features several emerging threads adjacent to model interpretability. I’ve been out themespotting and this month’s article features several emerging threads adjacent to the interpretability of machine learning models. Machine learning model interpretability. Introduction. 2018-06-21).

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

AUGUST 13, 2012

Yehoshua I've covered this topic in detail in this blog post: Multi-Channel Attribution: Definitions, Models and a Reality Check. I explain three different models (Online to Store, Across Multiple Devices, Across Digital Channels) and for each I've highlighted: 1. What's possible to measure.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

DataRobot Blog

OCTOBER 4, 2022

This has prompted AI/ML model owners to retrain their legacy models using data from the post-COVID era, while adapting to continually fluctuating market trends and thinking creatively about forecasting. However, hand-coding, testing, evaluating and deploying highly accurate models is a tedious and time-consuming process.

Forecasting 59

Forecasting Sales Data-driven Modeling 59

Cloudera

JUNE 6, 2019

This duplication can become such a management nightmare that they may prefer to return to the original model and simply live with noisy neighbors. Furthermore, both Compute Cluster 1 and Compute Cluster 2 can operate on the same copy of the data with a single set of security policies. A Better Approach: Virtual Private Clusters.

Metadata 85

Metadata Data Lake Optimization Strategy 85

Occam's Razor

SEPTEMBER 15, 2014

In this post we will look mobile sites first, both data collection and analysis, and then mobile applications. Media-Mix Modeling/Experimentation. Media-Mix Modeling/Experimentation. I've covered the value of media-mix modeling (nee. I love media-mix modeling. Tag your mobile website.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

MARCH 23, 2010

Having two tools guarantees you are going to be data collection, data processing and data reconciliation organization. If you blog that a short on-exit survey or a feedback button is a great way to collect voice of customer, I don't have to be lazy or hyper paranoid and wait for a convincing case study.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

OCTOBER 19, 2010

If you can show ROI on a DW it would be a good use of your money to go with Omniture Discover, WebTrends Data Mart, Coremetrics Explore. If you have evolved to a stage that you need behavior targeting then get Omniture Test and Target or Sitespect. Move from a data collection obsession and develop a crush on data analysys.

Analytics 135

Analytics Testing Measurement Optimization 135

Occam's Razor

JULY 18, 2011

The only requirement is that your mental model (and indeed, company culture) should be solidly rooted in permission marketing. You just have to have the right mental model (see Seth Godin above) and you have to… wait for it… wait for it… measure everything you do! Just to ensure you are executing against your right mental model.

Metrics 137

Metrics Marketing Measurement Cost-Benefit 137

datapine

JANUARY 31, 2022

The companies that are most successful at marketing in both B2C and B2B are using data and online BI tools to craft hyper-specific campaigns that reach out to targeted prospects with a curated message. Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

1]" Statistics, as a discipline, was largely developed in a small data world. Implicitly, there was a prior belief about some interesting causal mechanism or an underlying hypothesis motivating the collection of the data. We must correct for multiple hypothesis tests. We ought not dredge our data.

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

JANUARY 7, 2014

The organization functions off a clearly defined Digital Marketing & Measurement Model. #1. Remember none of these jobs will do any data collection/IT work, even in medium-sized companies.) More on the Digital Marketing & Measurement Model, DMMM, in #2 below.). You know what your Return on Analytics is!

Data-driven 140

Data-driven Consulting Reporting Marketing 140

Occam's Razor

APRIL 29, 2013

PS: The phrase "real-time data analysis" is an oxymoron. Real-time data is super valuable if zero human beings are involved from data collection to action being taken. There is a lot of intent data on the web. Leverage the mental models of our day and age and you'll be immensely successful.

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. When you go to the interview, the hiring company will proceed to ask questions that test your competency in the listed job requirements. This is normal.

Marketing 136

Marketing Analytics Machine Learning Strategy 136