Data Science and Beyond

APRIL 5, 2021

The initial covid-19 lockdown provided me with extra free time to make the measurement and offsetting of Automattic’s emissions from data centre power use happen. I previously posted about my experiences with RLS offline data collection and visualisation of the collected data , and have since helped with quite a few RLS surveys.

Experimentation 61

Experimentation Testing Publishing Measurement 61

Occam's Razor

APRIL 8, 2013

We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. Testing out a new feature.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

Dataiku

APRIL 22, 2022

For companies with small datasets and a mandate to move beyond experimentation, Frugal AI promises to be a way to overcome this challenge. Storage infrastructure and data collection/processing costs. Frugal by Design: Why Focus on the Data and Not the Code? Today, in 2022, the code (i.e.,

Experimentation 59

Experimentation Modeling Business Objectives Manufacturing 59

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

1]" Statistics, as a discipline, was largely developed in a small data world. Implicitly, there was a prior belief about some interesting causal mechanism or an underlying hypothesis motivating the collection of the data. We must correct for multiple hypothesis tests. We ought not dredge our data.

Experimentation 61

Experimentation Testing Statistics Metrics 61

Cloudera

FEBRUARY 16, 2022

blueberry spacing) is a measure of the model’s interpretability. We can think of model lineage as the specific combination of data and transformations on that data that create a model. This maps to the data collection, data engineering, model tuning and model training stages of the data science lifecycle.

Machine Learning 82

Machine Learning Modeling Metadata Recreation/Entertainment 82

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. These measurement-obsessed companies have an advantage when it comes to AI. It is similar to R&D.

Management 110

Management Machine Learning Experimentation Metrics 110

Domino Data Lab

MAY 8, 2019

The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. Instead, consider a “full stack” tracing from the point of data collection all the way out through inference. measure the subjects’ ability to trust the models’ results. . – back to the structure of the dataset.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Insight

MARCH 12, 2020

In this article, I will discuss the construction of the AIgent, from data collection to model assembly. Data Collection The AIgent leverages book synopses and book metadata. The latter is any type of external data that has been attached to a book? On my test set, this approach resulted in~75–95% accuracy and ~.65

Modeling 59

Modeling Metadata Publishing Sales 59

Domino Data Lab

OCTOBER 2, 2019

This article covers causal relationships and includes a chapter excerpt from the book Machine Learning in Production: Developing and Optimizing Data Science Workflows and Applications by Andrew Kelleher and Adam Kelleher. As data science work is experimental and probabilistic in nature, data scientists are often faced with making inferences.

Machine Learning 68

Machine Learning Measurement Modeling Testing 68

O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). What ideas to test first on your site? If you have no experience with Web Analytics then you'll learn what it is and the nitty gritty of data collection and core metrics such as Visits and Time on Site and Bounce Rate and Top Destinations etc.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Occam's Razor

JULY 18, 2011

You just have to have the right mental model (see Seth Godin above) and you have to… wait for it… wait for it… measure everything you do! For everything you do it is important to measure your effectiveness of all three phases of your effort: Acquisition. You’re trying to measure how well you are doing to: Send emails.

Metrics 137

Metrics Marketing Measurement Cost-Benefit 137

Cloudera

JUNE 6, 2019

We sometimes refer to this as splitting “dev/test” from “production” workloads, but we can generalize the approach by referring to the overall priority of the workload for the business. 3) By workload priority. A third strategy splits clusters based on the overall priority of the workloads running on those clusters. Cloudera Manager 6.2

Metadata 86

Metadata Data Lake Optimization Strategy 86

Occam's Razor

MARCH 23, 2010

Too many new things are happening too fast and those of us charged with measuring it have to change the wheels while the bicycle is moving at 30 miles per hour (and this bicycle will become a car before we know it – all while it keeps moving, ever faster). . ~ Usually at least a test. And I doubt it is going to happen soon.

Analytics 118

Analytics Consulting Metrics Experimentation 118

Occam's Razor

SEPTEMBER 15, 2014

But why blame others, in this post let's focus on one important reason whose responsibility can be squarely put on your shoulders and mine: Measurement. Create a distinct mobile website and mobile app measurement strategies. Media-Mix Modeling/Experimentation. Remember my stress earlier on measuring micro-outcomes?).

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

OCTOBER 19, 2010

If you can show ROI on a DW it would be a good use of your money to go with Omniture Discover, WebTrends Data Mart, Coremetrics Explore. If you have evolved to a stage that you need behavior targeting then get Omniture Test and Target or Sitespect. Move from a data collection obsession and develop a crush on data analysys.

Analytics 135

Analytics Testing Measurement Optimization 135

Occam's Razor

AUGUST 13, 2012

Yehoshua Coren: Best ways to measure user behavior in a multi-touch, multi-device digital world. What's possible to measure. What's not possible to measure. We all have smart phones, laptops, tablets and soon Smart TVs – but most of our measurements are usually done in Cookies that are device/browser specific.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

datapine

JANUARY 31, 2022

Because things are changing and becoming more competitive in every sector of business, the benefits of business intelligence and proper use of data analytics are key to outperforming the competition. Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

Occam's Razor

JANUARY 7, 2014

The organization functions off a clearly defined Digital Marketing & Measurement Model. #1. Remember none of these jobs will do any data collection/IT work, even in medium-sized companies.) More on the Digital Marketing & Measurement Model, DMMM, in #2 below.). Four Useless KPI Measurement Techniques. #9:

Data-driven 140

Data-driven Consulting Reporting Marketing 140

Occam's Razor

APRIL 29, 2013

PS: The phrase "real-time data analysis" is an oxymoron. Real-time data is super valuable if zero human beings are involved from data collection to action being taken. You measure bounce rate and you can find those things, then figure out if the problem is at the source (ads) or destination (your site).

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. When you go to the interview, the hiring company will proceed to ask questions that test your competency in the listed job requirements. This is normal. So on and so forth.

Marketing 136

Marketing Analytics Machine Learning Strategy 136