DataKitchen

AUGUST 3, 2021

The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. The communication between business units and data professionals is usually incomplete and inconsistent. Introduction to Data Mesh. Source: Thoughtworks.

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

TDAN

MAY 31, 2022

The main goal of creating an enterprise data fabric is not new. It is the ability to deliver the right data at the right time, in the right shape, and to the right data consumer, irrespective of how and where it is stored. Data fabric is the common “net” that stitches integrated data from multiple data […].

Metadata 98

Metadata Enterprise IT Data Architecture 98

AWS Big Data

OCTOBER 3, 2023

Over the years, data lakes on Amazon Simple Storage Service (Amazon S3) have become the default repository for enterprise data and are a common choice for a large set of users who query data for a variety of analytics and machine leaning use cases. Analytics use cases on data lakes are always evolving.

Data Lake 98

Data Lake Metadata Snapshot Recreation/Entertainment 98

Ontotext

APRIL 10, 2024

In most enterprises data teams lack a data map and data asset inventory and are often unaware of data that exists across the organization, its associated profile, quality and associated metadata. Teams can’t access data to build their business use cases. For example, a product data tag is basic metadata.

Metadata 52

Metadata Data Lake Data Warehouse Data Quality 52

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 96

Strategy Data Architecture Cost-Benefit Reporting 96

Data Virtualization

DECEMBER 21, 2023

Reading Time: 2 minutes Data mesh is a modern, distributed data architecture in which different domain based data products are owned by different groups within an organization. And data fabric is a self-service data layer that is supported in an orchestrated fashion to serve.

Data Governance 59

Data Governance Data Architecture Data Integration Management 59

Cloudera

JUNE 7, 2022

Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow.

IT 106

IT Data Architecture Unstructured Data Big Data 106

erwin

JANUARY 9, 2020

That’s because it’s the best way to visualize metadata , and metadata is now the heart of enterprise data management and data governance/ intelligence efforts. So here’s why data modeling is so critical to data governance. erwin Data Modeler: Where the Magic Happens.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

Alation

JANUARY 9, 2023

The Australian Prudential Regulation Authority (APRA) released nonbinding standards covering data risk management. Another agency later also published a legally binding standard to strengthen risk management for financial institutions with specific language related to data architecture and IT infrastructure.

Risk Management 52

Risk Management Risk Management Metadata 52

AWS Big Data

APRIL 26, 2023

This is a guest blog post co-written with Corey Johnson from Huron. Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more.

Metadata 52

Metadata Dashboards Visualization Consulting 52

IBM Big Data Hub

AUGUST 24, 2022

Remote runtime data integration as-a-service execution capabilities for on-premises and multi-cloud execution. Multi-directional data movement topology with high volume and low-latency integration. Support for data governance. Metadata exchange with third party metadata management and governance tools.

Data Integration 88

Data Integration Metadata Data-driven Data Architecture 88

erwin

FEBRUARY 28, 2024

While the essence of success in data governance is people and not technology, having the right tools at your fingertips is crucial. Technology is an enabler, and for data governance this is essentially having an excellent metadata management tool. Next to data governance, data architecture is really embedded in our DNA.

Metadata 52

Metadata Data Governance Data Quality Technology 52

erwin

OCTOBER 16, 2020

There’s a common denominator in what they’re all missing, and that is data intelligence. The erwin EDGE enables organizations to see how data flows through and impacts all their business, technology and data architectures. Parts of this blog are excerpted from my keynote on day No.

Internet of Things 145

Internet of Things Data-driven Uncertainty Data Governance 145

Ontotext

NOVEMBER 16, 2023

Figure 1 Shows the overall idea of a data mesh with the major components: What Is a Data Mesh and How Does It Work? Think of data mesh as an operational mode for organizations with a domain-driven, decentralized data architecture. What Is a Data Product and Who Owns Them?

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

erwin

MAY 13, 2020

The role of data modeling (DM) has expanded to support enterprise data management, including data governance and intelligence efforts. Metadata management is the key to managing and governing your data and drawing intelligence from it. Types of Data Models: Conceptual, Logical and Physical.

Data Governance 93

Data Governance Modeling Enterprise Management 93

Data Virtualization

JANUARY 17, 2023

Reading Time: 2 minutes In recent years, there has been a growing interest in data architecture. One of the key considerations is how best to handle data, and this is where data mesh and data fabric come into play. But what are the key.

Data Architecture 52

Data Architecture Data Integration Management Metadata 52

Alation

MARCH 31, 2023

Ehtisham Zaidi, Gartner’s VP of data management, and Robert Thanaraj, Gartner’s director of data management, gave an update on the fabric versus mesh debate in light of what they call the “active metadata era” we’re currently in. The foundations of successful data governance The state of data governance was also top of mind.

Data Analytics 52

Data Analytics Analytics Metadata Data Governance 52

Cloudera

MARCH 17, 2023

As the use of ChatGPT becomes more prevalent, I frequently encounter customers and data users citing ChatGPT’s responses in their discussions. I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics.

Unstructured Data 60

Unstructured Data Data Lake Data Warehouse Machine Learning 60

Ontotext

DECEMBER 1, 2023

Atanas Kiryakov presenting at KGF 2023 about Where Shall and Enterprise Start their Knowledge Graph Journey Only data integration through semantic metadata can drive business efficiency as “it’s the glue that turns knowledge graphs into hubs of metadata and content”.

Metadata 78

Metadata Sales Consulting Enterprise 78

erwin

JULY 12, 2019

Modern, strategic data governance , which involves both IT and the business, enables organizations to plan and document how they will discover and understand their data within context, track its physical existence and lineage, and maximize its security, quality and value. Five Steps to GDPR/CCPA Compliance. How erwin Can Help.

Data Governance 110

Data Governance Management Metadata Risk Management 110

Cloudera

JANUARY 5, 2023

This is where leveraging modern data architectures like data lakehouse, data fabric, and data mesh is essential to driving business efficiencies across diverse operations. These features provide businesses with a common metadata, security, and governance model across all their data.

Cost-Benefit 52

Cost-Benefit Business Objectives Machine Learning Data Architecture 52

Cloudera

OCTOBER 11, 2022

First you need the data analytics, data management, and data science tools. They all should work on shared data of any type – with common metadata management – ideally open. We believe the best path is with a hybrid data platform for modern data architectures with data anywhere.

Snapshot 89

Snapshot Data Science Digital Transformation Metadata 89

Ontotext

APRIL 15, 2020

Ontotext’s knowledge graph technology is at the core of Cochrane’s data architecture developed by our partners from Data Language. Here, GraphDB is used for storing the ontology models, the vocabulary, the content metadata and the graphs from the PICO ontology.

Publishing 105

Publishing Metadata Data mining Technology 105

erwin

MAY 31, 2019

The typical notion is that enterprise architects and data (and metadata) architects are in opposite corners. At Avydium , we believe there’s an important middle ground where different architecture disciplines coexist, including enterprise, solution, application, data, metadata and technical architectures.

Data-driven 104

Data-driven Enterprise Metadata Strategy 104

Cloudera

SEPTEMBER 15, 2022

The consumption of the data should be supported through an elastic delivery layer that aligns with demand, but also provides the flexibility to present the data in a physical format that aligns with the analytic application, ranging from the more traditional data warehouse view to a graph view in support of relationship analysis.

Data Lake 78

Data Lake Data Architecture Data-driven Data Warehouse 78

erwin

SEPTEMBER 17, 2020

With complex data architectures and systems within so many organizations, tracking data in motion and data at rest is daunting to say the least. Harvesting the data through automation seamlessly removes ambiguity and speeds up the processing time-to-market capabilities.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

AWS Big Data

JUNE 7, 2023

This is a guest blog post co-written with Sumesh M R from Cargotec and Tero Karttunen from Knowit Finland. They chose AWS Glue as their preferred data integration tool due to its serverless nature, low maintenance, ability to control compute resources in advance, and scale when needed.

Metadata 55

Metadata Data Lake Machine Learning Big Data 55

IBM Big Data Hub

JUNE 30, 2022

The diversity of data types, data processing, integration and consumption patterns used by organizations has grown exponentially. Extend data governance to foster trust in your data by creating transparency, eliminating bias and ensuring explainability for data and insights fueled by machine learning and AI.

Data Strategy 57

Data Strategy Strategy Business Objectives Data-driven 57

Cloudera

JUNE 18, 2022

In recent years, the term “data lakehouse” was coined to describe this architectural pattern of tabular analytics over data in the data lake. In a rush to own this term, many vendors have lost sight of the fact that the openness of a data architecture is what guarantees its durability and longevity.

Data Lake 89

Data Lake Data Warehouse Machine Learning Cost-Benefit 89

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Implementing a modern data architecture makes it possible for financial institutions to break down legacy data silos, simplifying data management, governance, and integration — and driving down costs.

Data Architecture 81

Data Architecture Risk Management Risk Management 81

Alation

FEBRUARY 20, 2020

But it is the contextual usage information of data that is critical to answer data consumers’ and stewards’ questions. Cataloging both data and queries provides insight into. How recently the data was used. How recently the data was updated. What the mapping is of technical metadata to business descriptions.

Metadata 52

Metadata Enterprise Data Processing Data Architecture 52

Alation

MARCH 1, 2023

We wanted to introduce a Kappa architecture to serve not only our operational data needs, but our analytical data needs too. And we wanted to do this through one data architecture where possible, so that we didn’t duplicate processes. We made data available to those that needed it and the experts that are there.

Data Strategy 52

Data Strategy Strategy Metadata Interactive 52

Cloudera

AUGUST 30, 2022

Modern data architectures. To eliminate or integrate these silos, the public sector needs to adopt robust data management solutions that support modern data architectures (MDAs). Deploying modern data architectures. Lack of sharing hinders the elimination of fraud, waste, and abuse.

Data Architecture 75

Data Architecture Data Lake Metadata Data Warehouse 75

Cloudera

SEPTEMBER 28, 2020

Transition from Navigator by migrating the business metadata (tags, entity names, custom properties, descriptions and technical metadata (Hive, Spark, HDFS, Impala) to Atlas. This allowed them to enable a modern data architecture, enhance their streaming capabilities and prepare for the next phase of the CDP Journey.

Testing 130

Testing Metadata Risk Data Science 130

Alation

APRIL 19, 2021

If an enterprise doesn’t have visibility into data, then the process can become time-consuming and costly. With a good plan and a modern data catalog, you can minimize the time and cost of cloud migration. Source: Webinar with data expert Ibby Rahmani: Emerging Trends in Data Architecture: What’s the Next Big Thing?

Cost-Benefit 111

Cost-Benefit Strategy Enterprise Data Strategy 111

erwin

OCTOBER 24, 2019

Untapped data, if mined, represents tremendous potential for your organization. While there has been a lot of talk about big data over the years, the real hero in unlocking the value of enterprise data is metadata , or the data about the data. Metadata Is the Heart of Data Intelligence.

Metadata 104

Metadata Management Data-driven Data Architecture 104

Data Virtualization

MAY 19, 2023

Reading Time: 11 minutes The post Data Strategies for Getting Greater Business Value from Distributed Data appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Strategy 52

Data Strategy Strategy Data Integration Management 52