O'Reilly on Data

DECEMBER 12, 2019

In addition to newer innovations, the practice borrows from model risk management, traditional model diagnostics, and software testing. Security vulnerabilities : adversarial actors can compromise the confidentiality, integrity, or availability of an ML model or the data associated with the model, creating a host of undesirable outcomes.

Machine Learning 191

Machine Learning Modeling Testing Risk Management 191

O'Reilly on Data

MARCH 31, 2020

But there’s a host of new challenges when it comes to managing AI projects: more unknowns, non-deterministic outcomes, new infrastructures, new processes and new tools. This has serious implications for software testing, versioning, deployment, and other core development processes. Machine learning adds uncertainty.

Management 332

Management Machine Learning Experimentation Metrics 332

CDW Research Hub

AUGUST 19, 2019

Will it include a readout summary of volumes of orders and customers, distilled application monitoring metrics, review and signoff of marketing content? This requires coordination across multiple teams to get all of these applied and tested within the various environments, so don’t leave it to the last minute.

Testing 49

Testing Optimization Data Processing Strategy 49

Occam's Razor

MAY 22, 2006

This post is a primer on the delightful world of testing and experimentation (A/B, Multivariate, and a new term from me: Experience Testing). Experimentation and testing help us figure out we are wrong, quickly and repeatedly and if you think about it that is a great thing for our customers, and for our employers.

Experimentation 103

Experimentation Testing Optimization Measurement 103

datapine

FEBRUARY 9, 2024

4) How to Select Your KPIs 5) Avoid These KPI Mistakes 6) How To Choose A KPI Management Solution 7) KPI Management Examples Fact: 100% of statistics strategically placed at the top of blog posts are a direct result of people studying the dynamics of Key Performance Indicators, or KPIs. 3) What Are KPI Best Practices?

KPI 221

KPI Management Key Performance Indicator Measurement 221

AWS Big Data

MARCH 13, 2024

Each service implements k-nearest neighbor (k-NN) or approximate nearest neighbor (ANN) algorithms and distance metrics to calculate similarity. Ray cluster for ingestion and creating vector embeddings In our testing, we found that the GPUs make the biggest impact to performance when creating the embeddings.

Data Processing 109

Data Processing Dashboards Machine Learning Management 109

Occam's Razor

DECEMBER 3, 2008

If you want to have a move your career forward in web analytics (from a Metrics Analyst) here are the four options for you (and yes they all will help you make more money, some more than others): |1| Technical Individual Contributor. Your deep understanding of statistics etc is not required. Manager, Web Metrics.

Analytics 115

Analytics Consulting Metrics Reporting 115

The Unofficial Google Data Science Blog

JULY 18, 2023

Once we’ve answered that, we will then define and use metrics to understand the quality of human-labeled data, along with a measurement framework that we call Cross-replication Reliability or xRR. We will follow the example of Janson and Olsson , and start from this generalized definition of the metric, which they call iota.

Measurement 52

Measurement Metrics Uncertainty Slice and Dice 52

datapine

SEPTEMBER 16, 2022

But often that’s how we present statistics: we just show the notes, we don’t play the music.” – Hans Rosling, Swedish statistician. But if the same insights or metrics are presented in a simple graph, the number rises to 97%. Your Chance: Want to test a powerful data visualization software? back on every dollar spent.

Visualization 304

Visualization Dashboards Data-driven Statistics 304

datapine

FEBRUARY 23, 2023

2) Charts And Graphs Categories 3) 20 Different Types Of Graphs And Charts 4) How To Choose The Right Chart Type Data and statistics are all around us. That said, there is still a lack of charting literacy due to the wide range of visuals available to us and the misuse of statistics. Table of Contents 1) What Are Graphs And Charts?

Visualization 177

Visualization Dashboards Sales Measurement 177

Domino Data Lab

MAY 8, 2019

At CMU I joined a panel hosted by Zachary Lipton where someone in the audience asked a question about machine learning model interpretation. If your “performance” metrics are focused on predictive power, then you’ll probably end up with more complex models, and consequently less interpretable ones. Let’s look through some antidotes.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

AWS Big Data

JUNE 15, 2023

Follow along In the following examples, we often refer to two out-of-the-box sample topics, Product Sales and Student Enrollment Statistics , so you can follow along as you go. For example, the AWS Analytics sales leadership team uses QuickSight and Q to track key metrics for their region as part of their monthly business review.

Sales 66

Sales Dashboards Visualization Testing 66

datapine

MAY 17, 2021

Without a doubt, the best way to drive maximum value from the metrics, insights, and information is through something called data discovery. Your Chance: Want to test a professional data discovery tool for free? Your Chance: Want to test a professional data discovery tool for free? We offer a 14 day free trial.

Visualization 161

Visualization Data-driven Business Intelligence Metrics 161

O'Reilly on Data

JANUARY 25, 2021

Both SRE and DevOps emphasize similar practices: version control (62% growth for GitHub, and 48% for Git), testing (high usage, though no year-over-year growth), continuous deployment (down 20%), monitoring (up 9%), and observability (up 128%). It’s particularly difficult if testing includes issues like fairness and bias.

Machine Learning 363

Machine Learning Software Testing Technology 363

Andrew White

JANUARY 11, 2021

On January 4th I had the pleasure of hosting a webinar. Storytelling is a nice one to use early on to test the approach. But we are seeing increasing data suggesting that broad and bland data literacy programs, for example statistics certifying all employees of a firm, do not actually lead to the desired change. Yes, and no.

Data Analytics 52

Data Analytics Analytics Data-driven Finance 52

Jet Global

MAY 1, 2023

As a result, end users can better view shared metrics (backed by accurate data), which ultimately drives performance. When treating a patient, a doctor may wish to study the patient’s vital metrics in comparison to those of their peer group. They can also create custom calculations and metrics, and build new data visualizations.

Analytics 52

Analytics Cost-Benefit Visualization Dashboards 52