Remove 2011 Remove Measurement Remove Metrics Remove Modeling
article thumbnail

Measuring Validity and Reliability of Human Ratings

The Unofficial Google Data Science Blog

E ven after we account for disagreement, human ratings may not measure exactly what we want to measure. Researchers and practitioners have been using human-labeled data for many years, trying to understand all sorts of abstract concepts that we could not measure otherwise. That’s the focus of this blog post.

article thumbnail

When models are everywhere

O'Reilly on Data

Not all models are created equal, however: they operate on different principles, and impact us as individuals and communities in different ways. To understand the menagerie of models that are fundamentally altering our individual and shared realities, we need to build a typology, a classification of their effects and impacts.

Modeling 195
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Running Code and Failing Models

DataRobot

Even if all the code runs and the model seems to be spitting out reasonable answers, it’s possible for a model to encode fundamental data science mistakes that invalidate its results. These errors might seem small, but the effects can be disastrous when the model is used to make decisions in the real world.

article thumbnail

Rising Tide Rents and Robber Baron Rents

O'Reilly on Data

From 2000 to 2011, the percentage of US adults using the internet had grown from about 60% to nearly 80%. Some of those innovations, like Amazon’s cloud computing business, represented enormous new markets and a new business model. The market was maturing. By the end of 2012, it was up to 82%. These companies did continue to innovate.

article thumbnail

Automating Model Risk Compliance: Model Validation

DataRobot Blog

Last time , we discussed the steps that a modeler must pay attention to when building out ML models to be utilized within the financial institution. In summary, to ensure that they have built a robust model, modelers must make certain that they have designed the model in a way that is backed by research and industry-adopted practices.

Risk 52
article thumbnail

The Lean Analytics Cycle: Metrics > Hypothesis > Experiment > Act

Occam's Razor

To win in business you need to follow this process: Metrics > Hypothesis > Experiment > Act. We are far too enamored with data collection and reporting the standard metrics we love because others love them because someone else said they were nice so many years ago. This should not be news to you. But it is not routine.

Metrics 156
article thumbnail

How to Optimize Marketing and Sales Operations

Jedox

The description of the sales funnel is often used: individual stages of the sales process enable the measurement of key figures from the first contact to the conclusion with a signed contract or product purchased. The evolution of marketing data. Finding and leveraging the right data tools. Collaboration and integration are key.

Sales 95