IBM Big Data Hub

APRIL 20, 2023

We’ve seen what follows—financial crises, bailouts, destruction of capital, and losses of jobs. This trust depends on an understanding of the data that inform risk models: where does it come from, where is it being used, and what are the ripple effects of a change?

Risk 71

Risk Risk Management Reporting Metadata 71

erwin

SEPTEMBER 10, 2020

Not Documenting End-to-End Data Lineage Is Risky Busines – Understanding your data’s origins is key to successful data governance. Not everyone understands what end-to-end data lineage is or why it is important. Data Lineage Tells an Important Origin Story. Who are the data owners?

Data Governance 131

Data Governance Key Performance Indicator Digital Transformation Metadata 131

Octopai

APRIL 19, 2021

Aptly named, metadata management is the process in which BI and Analytics teams manage metadata, which is the data that describes other data. In other words, data is the context and metadata is the content. Without metadata, BI teams are unable to understand the data’s full story. TDWI – David Loshin.

Metadata 52

Metadata Management Business Intelligence Data Governance 52

Alation

AUGUST 18, 2022

How do you approach data lineage? We all know that data lineage is a complex and challenging topic. In this blog, I am drilling into something I’ve been thinking about and studying for a long time: fundamental approaches to lineage creation and maintenance. But what data things are interconnected?

Metadata 69

Metadata Visualization Statistics Data Architecture 69

erwin

APRIL 16, 2024

The data mesh framework In the dynamic landscape of data management, the search for agility, scalability, and efficiency has led organizations to explore new, innovative approaches. One such innovation gaining traction is the data mesh framework. This empowers individual teams to own and manage their data.

Metadata 52

Metadata Data Quality Data Governance Modeling 52

Cloudera

FEBRUARY 11, 2022

However, to understand what Ethical AI is, we need to have at least a basic understanding of ML, ML models and the data science lifecycle and how they are related. This blog post hopes to provide this foundational understanding. What is Machine Learning. Instead, they are learned by training a model on data.

Machine Learning 93

Machine Learning Sales Data Science Modeling 93

DataKitchen

FEBRUARY 2, 2023

We’ve read many predictions for 2023 in the data field: they cover excellent topics like data mesh, observability, governance, lakehouses, LLMs, etc. What will the world of data tools be like at the end of 2025? What will exist at the end of 2025? ’ They are data enabling vs. value delivery.

Metadata 130

Metadata Testing Risk Data Science 130

Smart Data Collective

APRIL 20, 2022

Errors in data entry might have serious effects if they are not discovered quickly. Human mistake is the most common cause of data entry errors. Since typical data entry errors may be minimized with the right steps, there are numerous data lineage tool strategies that a corporation can follow. Make Enough Hires.

Data Processing 135

Data Processing Data Collection Technology Optimization 135

erwin

FEBRUARY 28, 2024

At Sparkle, we’re a holistic data partner helping organizations increase their data maturity in a strategic yet pragmatic way. One of the key ingredients to ensure data is really embedded in an organization, and one of the key enablers to increase the strategic impact of data, is the setup of a successful data governance program.

Metadata 52

Metadata Data Governance Data Quality Technology 52

Octopai

JULY 17, 2022

will be met with a blank stare – because your conversation partner has no English and therefore no way of processing what you just said. Worse is if your “good morning” sounds like something else in the local language, and your addressee assumes he did process what you said. What monetary standard are you coming from?

Machine Learning 84

Machine Learning Visualization Enterprise Software 84

Alation

FEBRUARY 7, 2023

That was my earliest taste of data lineage. It wouldn’t be until 2013 that the topic of data lineage would surface again – this time while working on a data warehouse project. Data warehouses obfuscate data’s origin In 2013, I was a Business Intelligence Engineer at a financial services company.

Metadata 52

Metadata Data Warehouse Visualization Data Quality 52

erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. It’s paramount that organizations understand the benefits of automating end-to-end data lineage. The importance of end-to-end data lineage is widely understood and ignoring it is risky business.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

DataKitchen

AUGUST 24, 2023

Since the first edition of the DataOps Cookbook in 2019, we have talked with thousands of companies about their struggles to deliver data-driven insight to their customers. They have built data and analytic systems with great hope of success. As an industry, we have a conceptual hole in how we think about data analytic systems.

Data-driven 130

Data-driven Forecasting Metrics Dashboards 130

Cloudera

AUGUST 10, 2021

Follow your data in object storage on-premises. With Apache Ozone on the Cloudera Data Platform (CDP) , they can implement a scale-out model and build out their next generation storage architecture without sacrificing security, governance and lineage. Ozone stores data as objects which live inside these buckets.

Testing 103

Testing Metadata IT Modeling 103

Cloudera

FEBRUARY 16, 2022

What if the spacing between blueberries in a muffin is reduced? What if a muffin is well-baked? What if it is an irregular shape? The complete list is shown below: Model Lineage . Machine Learning Model Lineage. classification problem. Figure 01: Is this a chihuahua or a muffin? Model Visibility.

Machine Learning 82

Machine Learning Modeling Metadata Recreation/Entertainment 82

Cloudera

DECEMBER 1, 2022

Full-stack observability is a critical requirement for effective modern data platforms to deliver the agile, flexible, and cost-effective environment organizations are looking for. RI is a global leader in the design and deployment of large-scale, production-level modern data platforms for the world’s largest enterprises.

Metrics 82

Metrics Data Quality Data Lake Statistics 82

DataKitchen

NOVEMBER 10, 2023

The Perilous State of Today’s Data Environments Data teams often navigate a labyrinth of chaos within their databases. Extrinsic Control Deficit: Many of these changes stem from tools and processes beyond the immediate control of the data team. Identifying Anomalies: Use advanced algorithms to detect anomalies in data patterns.

Data Quality 141

Data Quality Testing Data Lake Data Integration 141

Jen Stirrup

OCTOBER 28, 2019

The Microsoft Power BI team have released a preview Data Lineage feature and it is a good start for organizations who are starting to think about data management. The Power BI lineage view displays the lineage relationships between all the artifacts in a workspace, and all its external dependencies.

IT 85

IT Business Intelligence Data Governance ROI 85

erwin

FEBRUARY 6, 2020

As organizations deal with managing ever more data, the need to automate data management becomes clear. Last week erwin issued its 2020 State of Data Governance and Automation (DGA) Report. One piece of the research that stuck with me is that 70% of respondents spend 10 or more hours per week on data-related activities.

Management 144

Management Data Governance Cost-Benefit Metadata 144

Cloudera

NOVEMBER 29, 2023

What does the Model Registry offer? Lineage Tracking : It’s essential to maintain traceability in MLOps. The Model Registry records who made changes to a model, when these changes were made, and what the changes entailed. In the dynamic world of machine learning operations (MLOps), staying ahead of the curve is essential.

Modeling 83

Modeling Machine Learning Metadata Metrics 83

erwin

OCTOBER 16, 2020

It’s certainly no secret that data has been growing in volume, variety and velocity, and most companies are overwhelmed by managing it, let alone harnessing it to put it to work. quintillion bytes of data every day, and 90% of the world’s data volume has been created in the past two years alone.

Internet of Things 145

Internet of Things Data-driven Uncertainty Data Governance 145

erwin

FEBRUARY 19, 2021

Metadata management is key to wringing all the value possible from data assets. However, most organizations don’t use all the data at their disposal to reach deeper conclusions about how to drive revenue, achieve regulatory compliance or accomplish other strategic objectives. What Is Metadata? Harvest data.

Metadata 110

Metadata Management Data Quality Cost-Benefit 110

Domino Data Lab

AUGUST 6, 2021

What Is Model Governance? What Is Model Governance? This includes: Model lineage, from data acquisition to model building Model versions in production, as they are updated based on new data Model health in production with model monitoring principles Model usage and basic functionality in production Model costs.

Machine Learning 145

Machine Learning Modeling Testing Risk 145

erwin

FEBRUARY 13, 2020

When an organization’s data governance and metadata management programs work in harmony, then everything is easier. Data governance is a complex but critical practice. There’s always more data to handle, much of it unstructured; more data sources, like IoT, more points of integration, and more regulatory compliance requirements.

Metadata 135

Metadata Data Governance Management Cost-Benefit 135

erwin

AUGUST 1, 2023

Intro erwin ® Data Modeler 12.5 It requires many functional elements of an organization to come together in order to reach the ultimate stages of being able to identify, understand and fully leverage the power of its data. erwin Data Modeler 12.5 erwin Data Modeler 12.5 erwin Data Modeler 12.5 bring to you?

Modeling 52

Modeling Metadata Data Quality Data Governance 52

Cloudera

OCTOBER 26, 2020

Just like when it comes to data access in business. Enabling data access for end-users so they can drive insight and business value is a typical area of compromise between IT and users. Data access can either be very secure but restrictive or very open yet risky. Quickly onboard data. Multi-tenant data access.

IT 117

IT Unstructured Data Data-driven Data Governance 117

erwin

FEBRUARY 4, 2021

Better decision-making has now topped compliance as the primary driver of data governance. However, organizations still encounter a number of bottlenecks that may hold them back from fully realizing the value of their data in producing timely and relevant business insights. Data Governance Bottlenecks. Sources, like IoT.

Data Governance 89

Data Governance Metadata Data Quality Risk Management 89

Andrew White

JULY 5, 2023

I blogged recently about the high level of hype and confusion across Data and Analytics just a few months ago. Here is the original blog from March 2023: Summing Up Three Days at Gartner’s Data and Analytics Conference in Orlando, Florida, USA. The fact that there are different names is one thing.

Metrics 52

Metrics Metadata Modeling Data Quality 52

erwin

MAY 18, 2022

Last week, Quest released erwin Data Intelligence by Quest version 12.0, a pivotal release for erwin Data Intelligence customers. Industry analysts, data domain field experts and erwin Data Intelligence customer advisory board members have all shown positive early reactions to its new capabilities in several key areas.

Data Quality 52

Data Quality Metadata Data Governance Software 52

DataKitchen

JULY 3, 2023

Data Journey First DataOps Putting Problems in Your Data Estate at the Forefront Welcome to the high-octane world of DataOps, a powerhouse that turbocharges data analytics development and management. But as we navigate ever-evolving seas of data, it’s high time we reset our course.

Testing 130

Testing Risk Data-driven Statistics 130

erwin

MARCH 25, 2021

erwin recently hosted the second in its six-part webinar series on the practice of data governance and how to proactively deal with its complexities. Led by Frank Pörschmann of iDIGMA GmbH, an IT industry veteran and data governance strategist, the second webinar focused on “ The Value of Data Governance & How to Quantify It.”.

Data Governance 109

Data Governance IT Cost-Benefit Risk 109

Cloudera

AUGUST 12, 2021

In my previous blog post, I shared examples of how data provides the foundation for a modern organization to understand and exceed customers’ expectations. Collecting workforce data as a tool for talent management. Streamlining operations with advanced analytics to preempt issues.

Data-driven 107

Data-driven Manufacturing Insurance Risk Management 107

erwin

JUNE 14, 2023

Data democratization is a hot topic, but what does it mean? And more importantly, how can you successfully democratize data? The focus of data democratization has traditionally been on closing the delivery gap between IT and business users specifically while keeping data protected in that context.

Data Quality 52

Data Quality Metrics Data Governance Enterprise 52

erwin

AUGUST 7, 2019

A data catalog benefits organizations in a myriad of ways. With the right data catalog tool, organizations can automate enterprise metadata management – including data cataloging, data mapping, data quality and code generation for faster time to value and greater accuracy for data movement and/or deployment projects.

Metadata 90

Metadata Data Governance Data Quality Data Warehouse 90

DataKitchen

AUGUST 13, 2021

If a company can use data to identify compounds more quickly and accelerate the development process, it can monetize its drug pipeline more effectively. DataOps automation provides a way to boost innovation and improve collaboration related to data in pharmaceutical research and development (R&D). Mastery of Heterogeneous Tools.

Testing 246

Testing Dashboards Marketing Measurement 246

erwin

AUGUST 28, 2020

Organizations with a solid understanding of data governance (DG) are better equipped to keep pace with the speed of modern business. In this post, the erwin Experts address: What Is Data Governance? Why Is Data Governance Important? What Is Good Data Governance? What Are the Key Benefits of Data Governance?

Data Governance 145

Data Governance IT Cost-Benefit Metadata 145