DataRobot Blog

MAY 10, 2022

It has been over a decade since the Federal Reserve Board (FRB) and the Office of the Comptroller of the Currency (OCC) published its seminal guidance focused on Model Risk Management ( SR 11-7 & OCC Bulletin 2011-12 , respectively). With this definition of model risk, how do we ensure the models we build are technically correct?

Risk 64

Risk Modeling Machine Learning Data Quality 64

Occam's Razor

OCTOBER 21, 2013

In late 2011, Google announced an effort to make search behavior more secure. As an analyst, I was upset that this change would hurt my ability to analyze the effectiveness of my beloved search engine optimization (SEO) efforts – which are really all about finding the right users using optimal content strategies.

Optimization 154

Optimization Reporting Experimentation Metrics 154

Occam's Razor

JANUARY 20, 2010

End of a minor web analytics lesson on going beyond obvious metrics and never, ever, never forgetting context. Dos: You want that traffic to come on the optimal set of keywords (why simply bounce traffic?). Only upon reading the actual questions could I figure out which case it was (mercifully case #1 for me!). Back to our story.

Metrics 90

Metrics B2B Analytics Measurement 90

Occam's Razor

MAY 14, 2012

Bonus One: Read: Brand Measurement: Analytics & Metrics for Branding Campaigns ]. There are many different tools, both online and offline, that measure the elusive metric called brand strength. They are full of specific insights you can use to optimize your online search campaigns. Step 3: Click Search.

Measurement 128

Measurement Analytics Advertising Marketing 128

Occam's Razor

APRIL 25, 2011

This latter category contains things that are so obviously sub-optimal that no one should be doing them any more. Sophisticated Search Engine Optimization is mandatory in our world of Bing / Yandex / Baidu / Google. " I'd postulated this rule in 2005, it is even more true in 2011. Yet there they are. The 10/90 rule.

Marketing 126

Marketing Measurement Metrics Testing 126

Occam's Razor

JUNE 28, 2011

Web Analysts are blessed with an immense amount of data, and an amazing amount of valuable, even sexy, metrics to understand business performance. Yet our heroic efforts to report the aforementioned sexy metrics lead to little business action. Since crappy sounds bad, let's just say you are reporting super lame metrics.

Metrics 126

Metrics Measurement Key Performance Indicator Reporting 126

Occam's Razor

FEBRUARY 22, 2010

Feel better? : ) When should you start doing paid search advertising for tours to Italy for 2011? The secret to making optimal use of CI data lies in one single realization: You must ensure you understand how the data you are analyzing is collected. Your traffic grew by 6% last year, what was your competitor's growth rate?

Metrics 123

Metrics Advertising Reporting Software 123

Domino Data Lab

MARCH 3, 2019

We had big surprises at several turns and have subsequently published a series of reports. Let’s look through some of the insights gained from those reports. Seriously, this entire article merely skims the surface of those reports. What metrics are used to evaluate success? Meanwhile, the landscape is evolving rapidly.

Data Science 49

Data Science Deep Learning Machine Learning Modeling 49

Smart Data Collective

JUNE 6, 2021

If your company deals with hundreds or thousands of customers, optimal productivity, budgeting and customer satisfaction should be at the top of your priority list. Big data analytics can be used for multiple purposes while offering a wide range of advantages in comparison to other methods of reporting, tracking and management.

Big Data 132

Big Data Data Analytics Analytics Cost-Benefit 132

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

With more features come more potential post hoc hypotheses about what is driving metrics of interest, and more opportunity for exploratory analysis. Looking at metrics of interest computed over subpopulations of large data sets, then trying to make sense of those differences, is an often recommended practice (even on this very blog).

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

NOVEMBER 2, 2015

Success Metrics. In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). It can be a brand metric, say Likelihood to Recommend. Business Leaders.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

O'Reilly on Data

MAY 11, 2020

It predates recommendation engines, social media, engagement metrics, and the recent explosion of AI, but not by much. The Entertainment” is not the result of algorithms, business incentives and product managers optimizing for engagement metrics. YOUTUBE, CONSPIRACY, AND OPTIMIZATION.

Modeling 190

Modeling Advertising Recreation/Entertainment Metrics 190