IBM Big Data Hub

NOVEMBER 3, 2023

As a result, I see access to real-time data as a necessary foundation for building business agility and enhancing decision making. Stream processing is at the core of real-time data. Apache Kafka streams get data to where it needs to go, but these capabilities are not maximized when Apache Kafka is deployed in isolation.

Cost-Benefit 78

Cost-Benefit Experimentation Testing Digital Transformation 78

AWS Big Data

NOVEMBER 2, 2023

GoDaddy is a data-driven company, and getting meaningful insights from data helps us drive business decisions to delight our customers. As a part of this vision, GoDaddy’s Data & ML Platform team plans to use EMR Serverless as one of the compute solutions under the hood.

Cost-Benefit 89

Cost-Benefit Big Data Testing Optimization 89

Cloudera

APRIL 9, 2021

This blog series follows the manufacturing and operations data lifecycle stages of an electric car manufacturer – typically experienced in large, data-driven manufacturing companies. The first blog introduced a mock vehicle manufacturing company, The Electric Car Company (ECC) and focused on Data Collection.

Machine Learning 98

Machine Learning Forecasting Manufacturing Predictive Analytics 98

Sisense

JANUARY 21, 2020

Everyone wants to get more out of their data, but how exactly to do that can leave you scratching your head. One of the simplest ways to start exploring your data is to aggregate the metrics you are interested in by their relevant dimensions. How can good data lead to faulty conclusions? How does this happen? 9/10 = 90%.

Testing 104

Testing Risk Data-driven Statistics 104

The Unofficial Google Data Science Blog

APRIL 23, 2024

Experiments, Parameters and Models At Youtube, the relationships between system parameters and metrics often seem simple — straight-line models sometimes fit our data well. To find optimal values of two parameters experimentally, the obvious strategy would be to experiment with and update them in separate, sequential stages.

Experimentation 52

Experimentation Optimization Uncertainty Metrics 52

Domino Data Lab

AUGUST 5, 2019

This Domino Data Science Field Note covers Chris Wiggins ‘s recent data ethics seminar at Berkeley. Data Scientists, Tradeoffs, and Data Ethics. As more companies become model-driven , data scientists are uniquely positioned to drive innovation and to help their companies remain economically strong.

Data Science 93

Data Science Data-driven Modeling Machine Learning 93

DataRobot

APRIL 19, 2021

Data Scientists Are AI Experts. But for more complex business decisions, including those that use less structured data, we have artificial intelligence systems. Data scientists train the algorithms using datasets that contain curated learning examples. They need data assembly, data science, integration, and visualization skills.

Machine Learning 52

Machine Learning Visualization Data-driven Data Science 52

Domino Data Lab

NOVEMBER 14, 2019

This Domino Data Science Field Note covers a proposed definition of interpretability and distilled overview of the PDR framework. Yet, despite the complexity (or because of it), data scientists and researchers curate and use different languages, tools, packages, techniques, and frameworks to tackle the problem they are trying to solve.

Modeling 71

Modeling Machine Learning Data Science Experimentation 71

Alation

SEPTEMBER 28, 2022

The term has been used a lot more of late, especially in the data analytics industry, as we’ve seen it expand over the past few years to keep pace with new regulations, like the GDPR and CCPA. In essence, DataOps is a practice that helps organizations manage and govern data more effectively. What exactly is DataOps ?

Cost-Benefit 52

Cost-Benefit Data Quality Manufacturing Testing 52

DataKitchen

APRIL 13, 2021

This is not surprising given that DataOps enables enterprise data teams to generate significant business value from their data. Companies that implement DataOps find that they are able to reduce cycle times from weeks (or months) to days, virtually eliminate data errors, increase collaboration, and dramatically improve productivity.

Testing 300

Testing Machine Learning Consulting Data Quality 300

O'Reilly on Data

OCTOBER 19, 2021

As with many burgeoning fields and disciplines, we don’t yet have a shared canonical infrastructure stack or best practices for developing and deploying data-intensive applications. Why: Data Makes It Different. Not only is data larger, but models—deep learning models in particular—are much larger than before.

IT 346

IT Testing Experimentation Software 346

O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

CIO Business Intelligence

MARCH 7, 2023

Some IT organizations elected to lift and shift apps to the cloud and get out of the data center faster, hoping that a second phase of funding for modernization would come. Devops teams now look to shift left security and implement continuous testing to develop more innovative, secure, and reliable features from the start.

Digital Transformation 144

Digital Transformation Data Governance Experimentation Machine Learning 144

Domino Data Lab

JULY 28, 2021

The data science lifecycle (DLSC) has been defined as an iterative process that leads from problem formulation to exploration, algorithmic analysis and data cleaning to obtaining a verifiable solution that can be used for decision making. The data science process in a business environment begins with the Manage stage.

Data Science 59

Data Science Enterprise Modeling Experimentation 59

O'Reilly on Data

OCTOBER 13, 2020

In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing. From a technical perspective, it is entirely possible for ML systems to function on wildly different data. Debugging AI Products. Proper AI product monitoring is essential to this outcome.

Management 244

Management Metrics Machine Learning Modeling 244

The Unofficial Google Data Science Blog

JUNE 30, 2016

By IVAN DIAZ & JOSEPH KELLY Determining the causal effects of an action—which we call treatment—on an outcome of interest is at the heart of many data analysis efforts. In an ideal world, experimentation through randomization of the treatment assignment allows the identification and consistent estimation of causal effects.

Statistics 44

Statistics Optimization Modeling Experimentation 44

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Without large amounts of labeled training data solving most AI problems is not possible. Transcript.

Management 110

Management Machine Learning Experimentation Metrics 110

DataRobot

SEPTEMBER 14, 2021

Becoming AI-driven is no longer really optional. And for those that do make it past the experimental stage, it typically takes over 18 months for the value to be realized. At the same time, business and data analysts want to access intuitive, point-and-click tools that use automated best practices.

Machine Learning 94

Machine Learning Modeling Experimentation Visualization 94

Domino Data Lab

MAY 8, 2019

For example, common practices for collecting data to build training datasets tend to throw away valuable information along the way. The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. ML model interpretability and data visualization. St Paul’s from Madison London.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Domino Data Lab

JULY 2, 2019

Paco Nathan ‘s latest article covers program synthesis, AutoPandas, model-driven data queries, and more. In other words, using metadata about data science work to generate code. In this case, code gets generated for data preparation, where so much of the “time and labor” in data science work is concentrated.

Metadata 105

Metadata Machine Learning Data Science Data-driven 105

The Unofficial Google Data Science Blog

DECEMBER 14, 2021

by AMIR NAJMI & MUKUND SUNDARARAJAN Data science is about decision making under uncertainty. This blog post introduces the notions of representational uncertainty and interventional uncertainty to paint a fuller picture of what the practicing data scientist is up against. Vignette: Data Science at fluff.ai

Uncertainty 56

Uncertainty Statistics Measurement Cost-Benefit 56

The Unofficial Google Data Science Blog

OCTOBER 21, 2015

by NIALL CARDIN, OMKAR MURALIDHARAN, and AMIR NAJMI When working with complex systems or phenomena, the data scientist must often operate with incomplete and provisional understanding, even as she works to advance the state of knowledge. There has been debate as to whether the term “data science” is necessary.

Slice and Dice 45

Slice and Dice Experimentation Data-driven Data Science 45

Domino Data Lab

AUGUST 26, 2019

Data scientists, machine learning (ML) researchers, and business stakeholders have a high-stakes investment in the predictive accuracy of models. Data scientists and researchers ascertain predictive accuracy of models using different techniques, methodologies, and settings, including model parameters and hyperparameters. Introduction.

Testing 79

Testing Modeling Machine Learning Metrics 79

DataRobot Blog

MARCH 7, 2023

DataRobot on Azure accelerates the machine learning lifecycle with advanced capabilities for rapid experimentation across new data sources and multiple problem types. This generates reliable business insights and sustains AI-driven value across the enterprise.

Data-driven 59

Data-driven Machine Learning Experimentation Data Lake 59

DataRobot

JANUARY 20, 2022

The following is a summary list of the key data-related priorities facing ICSs during 2022 and how we believe the combined Snowflake & DataRobot AI Cloud Platform stack can empower the ICS teams to deliver on these priorities. Key Data Challenges for Integrated Care Systems in 2022. Building data communities.

Data-driven 145

Data-driven Experimentation Modeling Predictive Modeling 145

datapine

JANUARY 31, 2022

Because things are changing and becoming more competitive in every sector of business, the benefits of business intelligence and proper use of data analytics are key to outperforming the competition. Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

CIO Business Intelligence

AUGUST 1, 2023

But with all the excitement and hype, it’s easy for employees to invest time in AI tools that compromise confidential data or for managers to select shadow AI tools that haven’t been through security, data governance, and other vendor compliance reviews.

Digital Transformation 98

Digital Transformation Unstructured Data Strategy Experimentation 98

CIO Business Intelligence

SEPTEMBER 27, 2023

The decision to launch this pilot phase was driven by a desire to stay ahead in the field, assess the potential applications of gen AI, and subsequently transition into targeted proof-of-concept projects,” says Vlad-George Iacob, vice president of engineering at Hackajob. IT leaders should create a “safe space” for innovation, Iacob says.

Strategy 123

Strategy Risk Data-driven Modeling 123

Domino Data Lab

OCTOBER 14, 2020

Guest post by Jeff Melching, Distinguished Engineer / Chief Architect Data & Analytics. We’ve developed a model-driven software platform, called Climate FieldView , that captures, visualizes, and analyzes a vast array of data for farmers and provides new insight and personalized recommendations to maximize crop yield.

Experimentation 99

Experimentation Modeling Deep Learning Testing 99

IBM Big Data Hub

SEPTEMBER 25, 2023

The magic behind Uber’s data-driven success Uber, the ride-hailing giant, is a household name worldwide. But what most people don’t realize is that behind the scenes, Uber is not just a transportation service; it’s a data and analytics powerhouse. Consider the magnitude of Uber’s footprint.

OLAP 92

OLAP Data Lake Data-driven Snapshot 92