Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. You’ll measure this effect by looking at a quantity called the average treatment effect (ATE). Introduction.

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). What's the optimal organization structure (and who should own web analytics!)? Benchmarking (exactly how you can do it), impactful actionable executive dashboards (what they should contain), creating a data driven organization. Qualitative and quantitative.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Occam's Razor

DECEMBER 12, 2016

You got me, I am ignoring all the data layer and custom stuff! But, at the end of the day presence of a Tag Manager communicates to me that the company is serious about data collection and data quality. Digital Marketing & Measurement Model. This is sub-optimal. All that is great. That's it.

Analytics 141

Analytics Data-driven Strategy Consulting 141

Domino Data Lab

MAY 8, 2019

The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. Instead, consider a “full stack” tracing from the point of data collection all the way out through inference. measure the subjects’ ability to trust the models’ results. training data”) show the tangible outcomes.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

JULY 18, 2011

To not have it as an active part of your marketing portfolio is sub-optimal. You just have to have the right mental model (see Seth Godin above) and you have to… wait for it… wait for it… measure everything you do! For everything you do it is important to measure your effectiveness of all three phases of your effort: Acquisition.

Metrics 137

Metrics Marketing Measurement Cost-Benefit 137

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. These measurement-obsessed companies have an advantage when it comes to AI.

Management 110

Management Machine Learning Experimentation Metrics 110

Cloudera

JUNE 6, 2019

This strategy works well for managing internal chargebacks, limiting the impact of less sophisticated users on more experienced users, and overall encouraging individuals to think about and optimize their jobs and queries now that they have a smaller (but dedicated) cluster. 2) By workload type. 3) By workload priority.

Metadata 85

Metadata Data Lake Optimization Strategy 85

Occam's Razor

SEPTEMBER 15, 2014

Company UX leaders are happy to stink less by taking the sub-optimal path of responsive design, rather than create a mobile-unique experience (your customers tend to do different things on your desktop site than your mobile site!). Create a distinct mobile website and mobile app measurement strategies. Tag your mobile website.

Metrics 141

Metrics Reporting Analytics Marketing 141

Domino Data Lab

FEBRUARY 4, 2019

We’ll unpack curiosity as a core attribute of effective data science, look at how that informs process for data science (in contrast to Agile, etc.), and dig into details about where science meets rhetoric in data science. That body of work has much to offer the practice of leading data science teams.

Data Science 66

Data Science Experimentation Data-driven Machine Learning 66

Occam's Razor

AUGUST 13, 2012

Yehoshua Coren: Best ways to measure user behavior in a multi-touch, multi-device digital world. What's possible to measure. What's not possible to measure. We all have smart phones, laptops, tablets and soon Smart TVs – but most of our measurements are usually done in Cookies that are device/browser specific.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

Occam's Razor

OCTOBER 19, 2010

Move from a data collection obsession and develop a crush on data analysys. A huge vast majority of clicks coming from search engines continue to be organic clicks (which is why I love and adore search engine optimization). You'll measure Task Completion Rate in 4Q (below). Google Website Optimizer.

Analytics 135

Analytics Testing Measurement Optimization 135

Occam's Razor

MARCH 23, 2010

My problem with these mistruths and FUD is that they result in a ton of practitioners and companies making profoundly sub optimal choices, which in turn results in not just much longer slogs but also spectacular career implosions and the entire web analytics industry suffering. This is sad. Even a little frustrating. Likely not.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

MAY 27, 2015

Here are the digital myths that are leading us down a profoundly sub-optimal path: 1. A data-first strategy is a winning formula. Per our friends at Wikipedia, Programmatic encompasses an array of technologies that automate the buying, placement and optimization of media inventory. Programmatic platforms are a panacea.

Marketing Analytics 153

Marketing Analytics Marketing Analytics Advertising 153

datapine

JANUARY 31, 2022

Because things are changing and becoming more competitive in every sector of business, the benefits of business intelligence and proper use of data analytics are key to outperforming the competition. Ultimately, business intelligence and analytics are about much more than the technology used to gather and analyze data. The results?

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

Occam's Razor

JANUARY 7, 2014

The organization functions off a clearly defined Digital Marketing & Measurement Model. #1. Remember none of these jobs will do any data collection/IT work, even in medium-sized companies.) More on the Digital Marketing & Measurement Model, DMMM, in #2 below.). Four Useless KPI Measurement Techniques. #9:

Data-driven 140

Data-driven Consulting Reporting Marketing 140

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

Implicitly, there was a prior belief about some interesting causal mechanism or an underlying hypothesis motivating the collection of the data. As computing and storage have made data collection cheaper and easier, we now gather data without this underlying motivation. Be skeptical, intellectually honest.

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

APRIL 29, 2013

PS: The phrase "real-time data analysis" is an oxymoron. Real-time data is super valuable if zero human beings are involved from data collection to action being taken. You measure bounce rate and you can find those things, then figure out if the problem is at the source (ads) or destination (your site).

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. Ask them what they worry about, ask them what they are solving for, ask them how they measure success, ask them what are two things on the horizon that they are excited about.

Marketing 136

Marketing Analytics Machine Learning Strategy 136