Alation

AUGUST 18, 2022

How do you approach data lineage? We all know that data lineage is a complex and challenging topic. In this blog, I am drilling into something I’ve been thinking about and studying for a long time: fundamental approaches to lineage creation and maintenance. But what data things are interconnected?

Metadata 69

Metadata Visualization Statistics Data Architecture 69

Cloudera

FEBRUARY 11, 2022

However, to understand what Ethical AI is, we need to have at least a basic understanding of ML, ML models and the data science lifecycle and how they are related. This blog post hopes to provide this foundational understanding. What is Machine Learning. Instead, they are learned by training a model on data.

Machine Learning 93

Machine Learning Sales Data Science Modeling 93

Smart Data Collective

APRIL 20, 2022

Errors in data entry might have serious effects if they are not discovered quickly. Human mistake is the most common cause of data entry errors. Since typical data entry errors may be minimized with the right steps, there are numerous data lineage tool strategies that a corporation can follow. Make Enough Hires.

Data Processing 133

Data Processing Data Collection Technology Optimization 133

erwin

FEBRUARY 28, 2024

At Sparkle, we’re a holistic data partner helping organizations increase their data maturity in a strategic yet pragmatic way. One of the key ingredients to ensure data is really embedded in an organization, and one of the key enablers to increase the strategic impact of data, is the setup of a successful data governance program.

Metadata 52

Metadata Data Governance Data Quality Technology 52

Octopai

JULY 17, 2022

will be met with a blank stare – because your conversation partner has no English and therefore no way of processing what you just said. Worse is if your “good morning” sounds like something else in the local language, and your addressee assumes he did process what you said. What monetary standard are you coming from?

Machine Learning 84

Machine Learning Visualization Enterprise Software 84

Alation

FEBRUARY 7, 2023

That was my earliest taste of data lineage. It wouldn’t be until 2013 that the topic of data lineage would surface again – this time while working on a data warehouse project. Data warehouses obfuscate data’s origin In 2013, I was a Business Intelligence Engineer at a financial services company.

Metadata 52

Metadata Data Warehouse Visualization Data Quality 52

erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. It’s paramount that organizations understand the benefits of automating end-to-end data lineage. The importance of end-to-end data lineage is widely understood and ignoring it is risky business.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

DataKitchen

AUGUST 24, 2023

Since the first edition of the DataOps Cookbook in 2019, we have talked with thousands of companies about their struggles to deliver data-driven insight to their customers. They have built data and analytic systems with great hope of success. As an industry, we have a conceptual hole in how we think about data analytic systems.

Data-driven 130

Data-driven Forecasting Metrics Dashboards 130

Cloudera

AUGUST 10, 2021

Follow your data in object storage on-premises. With Apache Ozone on the Cloudera Data Platform (CDP) , they can implement a scale-out model and build out their next generation storage architecture without sacrificing security, governance and lineage. Ozone stores data as objects which live inside these buckets.

Testing 103

Testing Metadata IT Modeling 103

Cloudera

FEBRUARY 16, 2022

What if the spacing between blueberries in a muffin is reduced? What if a muffin is well-baked? What if it is an irregular shape? The complete list is shown below: Model Lineage . Machine Learning Model Lineage. classification problem. Figure 01: Is this a chihuahua or a muffin? Model Visibility.

Machine Learning 82

Machine Learning Modeling Metadata Recreation/Entertainment 82

Cloudera

DECEMBER 1, 2022

Full-stack observability is a critical requirement for effective modern data platforms to deliver the agile, flexible, and cost-effective environment organizations are looking for. RI is a global leader in the design and deployment of large-scale, production-level modern data platforms for the world’s largest enterprises.

Metrics 82

Metrics Data Quality Data Lake Statistics 82

DataKitchen

NOVEMBER 10, 2023

The Perilous State of Today’s Data Environments Data teams often navigate a labyrinth of chaos within their databases. Extrinsic Control Deficit: Many of these changes stem from tools and processes beyond the immediate control of the data team. Identifying Anomalies: Use advanced algorithms to detect anomalies in data patterns.

Data Quality 141

Data Quality Testing Data Lake Data Integration 141

Cloudera

NOVEMBER 29, 2023

What does the Model Registry offer? Lineage Tracking : It’s essential to maintain traceability in MLOps. The Model Registry records who made changes to a model, when these changes were made, and what the changes entailed. In the dynamic world of machine learning operations (MLOps), staying ahead of the curve is essential.

Modeling 83

Modeling Machine Learning Metadata Metrics 83

erwin

OCTOBER 16, 2020

It’s certainly no secret that data has been growing in volume, variety and velocity, and most companies are overwhelmed by managing it, let alone harnessing it to put it to work. quintillion bytes of data every day, and 90% of the world’s data volume has been created in the past two years alone.

Internet of Things 145

Internet of Things Data-driven Uncertainty Data Governance 145

Domino Data Lab

AUGUST 6, 2021

What Is Model Governance? What Is Model Governance? This includes: Model lineage, from data acquisition to model building Model versions in production, as they are updated based on new data Model health in production with model monitoring principles Model usage and basic functionality in production Model costs.

Machine Learning 145

Machine Learning Modeling Testing Risk 145

erwin

FEBRUARY 13, 2020

When an organization’s data governance and metadata management programs work in harmony, then everything is easier. Data governance is a complex but critical practice. There’s always more data to handle, much of it unstructured; more data sources, like IoT, more points of integration, and more regulatory compliance requirements.

Metadata 135

Metadata Data Governance Management Cost-Benefit 135

Cloudera

OCTOBER 26, 2020

Just like when it comes to data access in business. Enabling data access for end-users so they can drive insight and business value is a typical area of compromise between IT and users. Data access can either be very secure but restrictive or very open yet risky. Quickly onboard data. Multi-tenant data access.

IT 117

IT Unstructured Data Data-driven Data Governance 117

Andrew White

JULY 5, 2023

I blogged recently about the high level of hype and confusion across Data and Analytics just a few months ago. Here is the original blog from March 2023: Summing Up Three Days at Gartner’s Data and Analytics Conference in Orlando, Florida, USA. The fact that there are different names is one thing.

Metrics 52

Metrics Metadata Modeling Data Quality 52

erwin

MAY 18, 2022

Last week, Quest released erwin Data Intelligence by Quest version 12.0, a pivotal release for erwin Data Intelligence customers. Industry analysts, data domain field experts and erwin Data Intelligence customer advisory board members have all shown positive early reactions to its new capabilities in several key areas.

Data Quality 52

Data Quality Metadata Data Governance Software 52

DataKitchen

JULY 3, 2023

Data Journey First DataOps Putting Problems in Your Data Estate at the Forefront Welcome to the high-octane world of DataOps, a powerhouse that turbocharges data analytics development and management. But as we navigate ever-evolving seas of data, it’s high time we reset our course.

Testing 130

Testing Risk Data-driven Statistics 130

erwin

MARCH 25, 2021

erwin recently hosted the second in its six-part webinar series on the practice of data governance and how to proactively deal with its complexities. Led by Frank Pörschmann of iDIGMA GmbH, an IT industry veteran and data governance strategist, the second webinar focused on “ The Value of Data Governance & How to Quantify It.”.

Data Governance 109

Data Governance IT Cost-Benefit Risk 109

Cloudera

AUGUST 12, 2021

In my previous blog post, I shared examples of how data provides the foundation for a modern organization to understand and exceed customers’ expectations. Collecting workforce data as a tool for talent management. Streamlining operations with advanced analytics to preempt issues.

Data-driven 107

Data-driven Manufacturing Insurance Risk Management 107

erwin

AUGUST 7, 2019

A data catalog benefits organizations in a myriad of ways. With the right data catalog tool, organizations can automate enterprise metadata management – including data cataloging, data mapping, data quality and code generation for faster time to value and greater accuracy for data movement and/or deployment projects.

Metadata 90

Metadata Data Governance Data Quality Data Warehouse 90

Cloudera

SEPTEMBER 15, 2022

Cloudera Contributor: Mark Ramsey, PhD ~ Globally Recognized Chief Data Officer. July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. Luke: What is a modern data platform?

Data Lake 79

Data Lake Data Architecture Data-driven Data Warehouse 79

erwin

MARCH 30, 2020

Data intelligence has a critical role to play in the supercomputing battle against Covid-19. While leveraging supercomputing power is a tremendous asset in our fight to combat this global pandemic, in order to deliver life-saving insights, you really have to understand what data you have and where it came from.

Metadata 122

Metadata IT Data Governance Data Quality 122

DataKitchen

JUNE 19, 2023

Our recent survey showed that 97% of data engineers report experiencing burnout in their day-to-day jobs. Given the complicated distributed systems we use to get value from data and the diversity of data, we need a simplifying framework. That idea is the Data Journey.

Testing 130

Testing Cost-Benefit Metrics Data Quality 130

erwin

JANUARY 30, 2020

I’m excited to share the results of our new study with Dataversity that examines how data governance attitudes and practices continue to evolve. Defining Data Governance: What Is Data Governance? . 1 reason to implement data governance. Constructing a Digital Transformation Strategy: How Data Drives Digital.

Data Governance 145

Data Governance Metadata Digital Transformation Cost-Benefit 145

DataKitchen

MAY 4, 2023

Webinar Summary: DataOps and Data Mesh Chris Bergh, CEO of DataKitchen, delivered a webinar on two themes – Data Products and Data Mesh. Bergh started by discussing the complexity within data and analytics teams, stating that complexity makes everything more complicated and, in the long run, it kills productivity.

Measurement 130

Measurement Data-driven Testing Cost-Benefit 130

Cloudera

DECEMBER 3, 2021

In part 1 of this blog post, we discussed the need to be mindful of data bias and the resulting consequences when certain parameters are skewed. Surely there are ways to comb through the data to minimise the risks from spiralling out of control. An AI system trained on data has no context outside of that data.

Uncertainty 98

Uncertainty Measurement Metrics Modeling 98

erwin

SEPTEMBER 3, 2020

Why should you integrate data governance (DG) and enterprise architecture (EA)? Data governance provides time-sensitive, current-state architecture information with a high level of quality. Data governance provides time-sensitive, current-state architecture information with a high level of quality.

Data Governance 144

Data Governance Enterprise Risk Data Lake 144

Cloudera

JANUARY 17, 2024

Cloudera DataFlow for the Public Cloud (CDF-PC) is a complete self-service streaming data capture and movement platform based on Apache NiFi. It allows developers to interactively design data flows in a drag and drop designer, which can be deployed as continuously running, auto-scaling flow deployments or event-driven serverless functions.

Metrics 102

Metrics Dashboards Reporting Key Performance Indicator 102

erwin

JUNE 26, 2020

If you’re serious about a data-driven strategy , you’re going to need a data catalog. Organizations need a data catalog because it enables them to create a seamless way for employees to access and consume data and business assets in an organized manner. This also diminishes the value of data as an asset.

Metadata 132

Metadata Cost-Benefit Measurement Data-driven 132

IBM Big Data Hub

MARCH 4, 2024

Figure 1: Transforming into an AI+ enterprise is at the core of what our team at IBM does An AI+ enterprise integrates AI as a first-class function across the business. AI is at a turning point, driving exponential advancements in an organization’s prosperity and growth. times higher ROI.

Enterprise 104

Enterprise ROI Risk Strategy 104

Alation

NOVEMBER 28, 2022

Alation is excited to unveil Alation Connected Sheets , a new product that brings trusted, fresh data directly to spreadsheet users. Now, “spreadsheet jockeys” can pull the most current, compliant data directly from a range of cloud sources, without having to know SQL or depend on a data team to deliver it.

Descriptive Analytics 52

Descriptive Analytics Risk Sales Data-driven 52

Ontotext

FEBRUARY 12, 2024

Part one of this three-part series discussed the concept of data mesh and explored what it is and why an organization should care. Here, part two provides best practices for data mesh, including practical guidance, challenges, and limitations. Enterprises should identify and adopt specific data mesh elements to achieve velocity.

Data Quality 69

Data Quality Data-driven Data Lake Data Governance 69

IBM Big Data Hub

JANUARY 25, 2023

In our last blog , we introduced Data Governance: what it is and why it is so important. In this blog, we will explore the challenges that organizations face as they start their governance journey. Organizations have long struggled with data management and understanding data in a complex and ever-growing data landscape.

Data Governance 52

Data Governance Data-driven Strategy Management 52