Domino Data Lab

AUGUST 6, 2021

Data science is an incredibly complex field. Framing data science projects within the four steps of the data science lifecycle (DSLC) makes it much easier to manage limited resources and control timelines, while ensuring projects meet or exceed the business requirements they were designed for.

Data Science 75

Data Science Testing Modeling Publishing 75

Domino Data Lab

JULY 28, 2021

Data science is an exciting, interdisciplinary field that is revolutionizing the way companies approach every facet of their business. Data Science — A Venn Diagram of Skills. Data science encapsulates both old and new, traditional and cutting-edge. 3 Components of Data Science Skills.

Data Science 110

Data Science Statistics Recreation/Entertainment Predictive Analytics 110

IBM Big Data Hub

JULY 6, 2023

While data science and machine learning are related, they are very different fields. In a nutshell, data science brings structure to big data while machine learning focuses on learning from the data itself. What is data science? This post will dive deeper into the nuances of each field.

Machine Learning 58

Machine Learning Data Science Statistics Deep Learning 58

DataRobot

MARCH 5, 2019

In a previous blog post , we introduced you to Zach Deane-Mayer, a data scientist who runs our core modeling team. One of the most important tools in his team’s arsenal is a data science performance evaluation system created and maintained by our QA team.

Testing 72

Testing Machine Learning Data Science Modeling 72

Analytics Vidhya

JANUARY 2, 2024

Introduction In this technologically advanced era, programming languages come and go, but Python has stood the test of time, emerging as a titan in coding. Its simplicity, versatility, and robust community support have made it the go-to language for beginners and experts alike.

Testing 175

Testing Technology Analytics IT 175

IBM Big Data Hub

AUGUST 11, 2023

These insights can help drive decisions in business, and advance the design and testing of applications. Because ML is becoming more integrated into daily business operations, data science teams are looking for faster, more efficient ways to manage ML initiatives, increase model accuracy and gain deeper insights.

Data Science 56

Data Science Machine Learning Cost-Benefit Deep Learning 56

Analytics Vidhya

JANUARY 2, 2024

Introduction In this technologically advanced era, programming languages come and go, but Python has stood the test of time, emerging as a titan in coding. Its simplicity, versatility, and robust community support have made it the go-to language for beginners and experts alike.

Testing 143

Testing Technology Analytics IT 143

Rocket-Powered Data Science

FEBRUARY 15, 2023

These rules are not necessarily “Rocket Science” (despite the name of this blog site), but they are common business sense for most business-disruptive technology implementations in enterprises. Keep it agile, with short design, develop, test, release, and feedback cycles: keep it lean, and build on incremental changes.

Strategy 289

Strategy Experimentation Uncertainty Machine Learning 289

Domino Data Lab

JANUARY 20, 2019

These are the kind of questions Been Kim , Senior Research Scientist at Google Brain, poised in the MLConf 2018 talk , “Interpretability Beyond Feature Attribution: Testing with Concept Activation Vectors (TCAV)”. Testing with Concept Activation Vectors (TCAV): The Zebra. Introduction.

Testing 63

Testing Modeling Machine Learning Data Science 63

Alation

JULY 28, 2021

As data science processes continue to become operationalized and embedded within business processes, the importance of governing those processes continues to rise. While governance has been a major focus for many years when it comes to managing data, governance focused on data science processes is still far less mature.

Data Science 52

Data Science Data Governance Modeling Software 52

DataKitchen

AUGUST 9, 2021

The domain also includes code that acts upon the data, including tools, pipelines, and other artifacts that drive analytics execution. The domain requires a team that creates/updates/runs the domain, and we can’t forget metadata: catalogs, lineage, test results, processing history, etc., ….

Testing 246

Testing Data Lake Metadata Publishing 246

Domino Data Lab

FEBRUARY 20, 2019

Eugene Mandel , Head of Product at Superconductive Health , recently dropped by Domino HQ to candidly discuss cross-team collaboration within data science. Eugene Mandel , Head of Product at Superconductive Health , recently dropped by Domino HQ to discuss cross-team collaboration within data science.

Data Science 76

Data Science Testing Software Uncertainty 76

Cloudera

JANUARY 30, 2019

It’s official – Cloudera and Hortonworks have merged , and today I’m excited to announce the availability of Cloudera Data Science Workbench (CDSW) for Hortonworks Data Platform (HDP). Trusted by large data science teams across hundreds of enterprises —. What is CDSW?

Data Science 73

Data Science Machine Learning Experimentation Cost-Benefit 73

Domino Data Lab

JULY 20, 2022

We've blogged before about the importance of model validation, a process that ensures that the model is performing the way it was intended and that it solves the problem it was designed to solve. Validations and tests are key elements to building machine learning pipelines you can trust.

Machine Learning 98

Machine Learning Testing Modeling Data Integration 98

Domino Data Lab

JULY 28, 2021

Data science is a field at the convergence of statistics, computer science and business. Its value is so significant that scaling data science has become the new business imperative with organizations spending tens of millions of dollars on data, technology and talent. Data Science Techniques.

Data Science 45

Data Science Machine Learning Statistics Deep Learning 45

DataKitchen

JUNE 12, 2023

We had been talking about “Agile Analytic Operations,” “DevOps for Data Teams,” and “Lean Manufacturing For Data,” but the concept was hard to get across and communicate. I spent much time de-categorizing DataOps: we are not discussing ETL, Data Lake, or Data Science.

Testing 130

Testing Data Lake Dashboards Data Science 130

Insight

AUGUST 16, 2019

We at Insight offer a 7 week tuition-free Fellowship to transition into Data Engineering and have worked with hundreds of Fellows who had to overcome this exact hurdle. see below for the top 10 blog posts/resources! What is Data Engineering and what is the role of a Data Engineer?

Big Data 51

Big Data Data Science Data Processing Machine Learning 51

Domino Data Lab

AUGUST 6, 2021

All models require testing and auditing throughout their deployment and, because models are continually learning, there is always an element of risk that they will drift from their original standards. The primary focus of model governance involves tracking, testing and auditing. Purpose of Model Governance and Why It’s Important.

Machine Learning 145

Machine Learning Modeling Testing Risk 145

Rocket-Powered Data Science

JULY 6, 2023

I tested ChatGPT with my own account, and I was impressed with the results. You can find my results on my Medium blog site. Oh, by the way, I asked the generative AI at Stable Diffusion to create some images to go with my short story (which you can find on my Medium blog ). Guess what? It isn’t.

Statistics 151

Statistics Deep Learning Machine Learning Modeling 151

DataKitchen

FEBRUARY 21, 2023

are more efficient in prioritizing data delivery demands.” Release New Data Engineering Work Often With Low Risk: “Testing and release processes are heavily manual tasks… automate these processes.” His team is already on Azure and uses ADF, Synapse, PowerBi, and several powerful Azure Data Science tools.

Data-driven 130

Data-driven Testing Risk Cost-Benefit 130

DataKitchen

JANUARY 5, 2021

Execution of this mission requires the contribution of several groups: data center/IT, data engineering, data science, data visualization, and data governance. Each of the roles mentioned above views the world through a preferred set of tools: Data Center/IT – Servers, storage, software.

Testing 147

Testing Data Governance Metadata Visualization 147

Cloudera

JUNE 26, 2023

Here are some tips and tricks of the trade to prevent well-intended yet inappropriate data engineering and data science activities from cluttering or crashing the cluster. For data engineering and data science teams, CDSW is highly effective as a comprehensive platform that trains, develops, and deploys machine learning models.

Testing 76

Testing Data Processing Visualization Data Science 76

Cloudera

MAY 22, 2018

Cloudera Data Science Workbench (CDSW) makes secure, collaborative data science at scale a reality for the enterprise and accelerates the delivery of new data products. let the user document, test, and share the model. let the user document, test, and share the model. Simplified user administration.

Data Science 41

Data Science Snapshot Machine Learning Metadata 41

bridgei2i

MAY 11, 2020

Catalysing Digital CX using Data Science Capabilities in the Post COVID World. In this blog we will look at both the points in detail and discuss the adoption of digital for CX teams. IBM in a blog claimed that chatbots can help organizations reduce customer service costs by 30%. Change in interaction patterns.

Data Science 52

Data Science Interactive Enterprise Strategy 52

Cloudera

JUNE 3, 2022

Due to the lack of tooling specifically designed for data discovery, exploration, and preliminary analysis, this presents a significant challenge for these teams. . When it comes to the early stages in the data science process, data scientists often find themselves jumping between a wide range of tooling.

Dashboards 90

Dashboards Visualization Machine Learning Data Science 90

Domino Data Lab

MAY 1, 2019

This Domino Data Science Field Note provides highlights and excerpted slides from Chloe Mawer ’s “ The Ingredients of a Reproducible Machine Learning Model ” talk at a recent WiMLDS meetup. Mawer is a Principal Data Scientist at Lineage Logistics as well as an Adjunct Lecturer at Northwestern University.

Machine Learning 81

Machine Learning Testing Data Science Modeling 81

The Unofficial Google Data Science Blog

JANUARY 16, 2018

We present data from Google Cloud Platform (GCP) as an example of how we use A/B testing when users are connected. Experimentation on networks A/B testing is a standard method of measuring the effect of changes by randomizing samples into different treatment groups. Stratified sampling by component is in between.

Testing 58

Testing Experimentation Measurement Modeling 58

IBM Big Data Hub

FEBRUARY 13, 2024

Key considerations: Tech stack: Ensure your existing technology infrastructure can handle the demands of AI models and data processing. Teamwork: Assemble a team with expertise in AI, data science and your industry. Data: High-quality, relevant data is the fuel that powers generative AI success.

Enterprise 123

Enterprise Modeling Testing Data-driven 123

Domino Data Lab

JUNE 13, 2019

Recently, Chhavi Yadav (NYU) and Leon Bottou (Facebook AI Research and NYU) indicated in their paper, “ Cold Case: The Lost MNIST Digits ”, how they reconstructed the MNIST (Modified National Institute of Standards and Technology) dataset and added 50,000 samples to the test set for a total of 60,000 samples. Did they overfit the test set?

Testing 83

Testing Data Science Experimentation Metadata 83

Cloudera

MARCH 26, 2024

Containerized Compute Sessions: Run your development and testing tasks with ease. Our pursuit of innovative AI and data science technology will continue to help us develop even more impactful projects in the near future.” said Dr. David Hardoon, Group Chief Data & AI Officer, Union Bank of the Philippines.

Cost-Benefit 80

Cost-Benefit Machine Learning Enterprise Modeling 80

Cloudera

OCTOBER 14, 2020

By combining profound airline operation expertise, data science, and engine analytics to a predictive maintenance schedule, Lufthansa Technik can now ensure critical parts are on the ground (OTG) when needed, instead of the entire aircraft being OTG and not producing revenue. Fig 1: Turbofan jet engine.

Machine Learning 97

Machine Learning Modeling Cost-Benefit Testing 97

IBM Big Data Hub

MAY 8, 2023

This blog continues the discussion, now investigating the risks of adopting AI and proposes measures for a safe and judicious response to adopting AI. This is to ensure the AI model captures data inputs and usage patterns, required validations and testing cycles, and expected outputs.

Insurance 72

Insurance Risk Testing Data Quality 72

DataKitchen

JANUARY 3, 2022

For example, teams working under the VP/Directors of Data Analytics may be tasked with accessing data, building databases, integrating data, and producing reports. Data scientists derive insights from data while business analysts work closely with and tend to the data needs of business units.

Business Analytics 245

Business Analytics Analytics Testing Dashboards 245

Smart Data Collective

MARCH 5, 2022

Are you a data scientist ? Even if you already have a full-time job in data science, you will be able to leverage your expertise as a big data expert to make extra money on the side. Ways that Data-Savvy People Can Make Money with Side Hustles This Year. Become a user tester for apps and websites.

Data mining 134

Data mining Big Data Data-driven Data Science 134

Cloudera

SEPTEMBER 28, 2020

Cloudera has found that customers have spent many years investing in their big data assets and want to continue to build on that investment by moving towards a more modern architecture that helps leverage the multiple form factors. Data Science and machine learning workloads using CDSW. Test and QA. Test and QA.

Testing 131

Testing Metadata Risk Data Science 131

Smarten

JANUARY 30, 2024

Business users cannot even hope to prepare data for analytics – at least not without the right tools. Gartner predicts that, ‘data preparation will be utilized in more than 70% of new data integration projects for analytics and data science.’ So, why is there so much attention paid to the task of data preparation?

Analytics 67

Analytics Data Quality Visualization Metadata 67

Cloudera

APRIL 9, 2021

This is part 4 in this blog series. This blog series follows the manufacturing and operations data lifecycle stages of an electric car manufacturer – typically experienced in large, data-driven manufacturing companies. The second blog dealt with creating and managing Data Enrichment pipelines.

Machine Learning 98

Machine Learning Forecasting Manufacturing Predictive Analytics 98