O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. The case that might be familiar to you is an AB test. A complementary Domino project is available. .

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

AWS Big Data

JULY 3, 2023

Backtesting is a process used in quantitative finance to evaluate trading strategies using historical data. This helps traders determine the potential profitability of a strategy and identify any risks associated with it, enabling them to optimize it for better performance. Load the dataset into Amazon S3.

Snapshot 80

Snapshot Data Lake Testing Strategy 80

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). What's the optimal organization structure (and who should own web analytics!)? What ideas to test first on your site? The book takes a stand on issues, makes choices and cuts through the fog/FUD, in an attempt to make your life a tiny bit easier.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Yet, this challenge is not insurmountable. for what is and isn’t possible) to address these challenges. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110

Domino Data Lab

MAY 8, 2019

The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. Instead, consider a “full stack” tracing from the point of data collection all the way out through inference. Keep in mind that data science is fundamentally interdisciplinary. Let’s look through some antidotes.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Cloudera

JUNE 6, 2019

This strategy works well for managing internal chargebacks, limiting the impact of less sophisticated users on more experienced users, and overall encouraging individuals to think about and optimize their jobs and queries now that they have a smaller (but dedicated) cluster. 2) By workload type. 3) By workload priority.

Metadata 85

Metadata Data Lake Optimization Strategy 85

Occam's Razor

OCTOBER 19, 2010

If you can show ROI on a DW it would be a good use of your money to go with Omniture Discover, WebTrends Data Mart, Coremetrics Explore. If you have evolved to a stage that you need behavior targeting then get Omniture Test and Target or Sitespect. Move from a data collection obsession and develop a crush on data analysys.

Analytics 135

Analytics Testing Measurement Optimization 135

Occam's Razor

SEPTEMBER 15, 2014

Company UX leaders are happy to stink less by taking the sub-optimal path of responsive design, rather than create a mobile-unique experience (your customers tend to do different things on your desktop site than your mobile site!). In this post we will look mobile sites first, both data collection and analysis, and then mobile applications.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

MARCH 23, 2010

My problem with these mistruths and FUD is that they result in a ton of practitioners and companies making profoundly sub optimal choices, which in turn results in not just much longer slogs but also spectacular career implosions and the entire web analytics industry suffering. Usually at least a test. This is sad. Likely not.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

JULY 18, 2011

To not have it as an active part of your marketing portfolio is sub-optimal. Optimal Acquisition Email Metrics. Most email programs now have preview panes that typically block images and scripts (Outlook, Thunderbird, Gmail, everyone), and default settings prevent data collection due to concerns about viruses.

Metrics 137

Metrics Marketing Measurement Cost-Benefit 137

Occam's Razor

AUGUST 13, 2012

If you want to make the smartest decisions about your budget allocation then leveraging the time tested methodology of media mix modeling (at its core powered by controlled experiments) is the only way to go. I can use that to hypothesize what an optimal budget allocation might look like.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

datapine

JANUARY 31, 2022

The companies that are most successful at marketing in both B2C and B2B are using data and online BI tools to craft hyper-specific campaigns that reach out to targeted prospects with a curated message. Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

1]" Statistics, as a discipline, was largely developed in a small data world. Implicitly, there was a prior belief about some interesting causal mechanism or an underlying hypothesis motivating the collection of the data. We must correct for multiple hypothesis tests. We ought not dredge our data.

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

JANUARY 7, 2014

Remember none of these jobs will do any data collection/IT work, even in medium-sized companies.) But if their primary output is just data, and not actions to take expressed in English or verbally in weekly senior staff meeting, then they are simply Reporting Squirrels. Usability testing (lab based or online).

Data-driven 140

Data-driven Consulting Reporting Marketing 140

Occam's Razor

APRIL 29, 2013

PS: The phrase "real-time data analysis" is an oxymoron. Real-time data is super valuable if zero human beings are involved from data collection to action being taken. By lowering your bounce rate all you managed to accomplish is get your ads created and targeted properly and optimize the landing pages.

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. When you go to the interview, the hiring company will proceed to ask questions that test your competency in the listed job requirements. This is normal.

Marketing 136

Marketing Analytics Machine Learning Strategy 136