Octopai

JUNE 26, 2020

In order to figure out why the numbers in the two reports didn’t match, Steve needed to understand everything about the data that made up those reports – when the report was created, who created it, any changes made to it, which system it was created in, etc. Enterprise data governance. Metadata in data governance.

Metadata 84

Metadata Data Governance Enterprise Reporting 84

erwin

DECEMBER 12, 2019

Metadata is an important part of data governance, and as a result, most nascent data governance programs are rife with project plans for assessing and documenting metadata. But in many scenarios, it seems that the underlying driver of metadata collection projects is that it’s just something you do for data governance.

Metadata 52

Metadata Data Governance Digital Transformation Data Quality 52

Ontotext

APRIL 10, 2024

In most enterprises data teams lack a data map and data asset inventory and are often unaware of data that exists across the organization, its associated profile, quality and associated metadata. Teams can’t access data to build their business use cases. For example, a product data tag is basic metadata.

Metadata 52

Metadata Data Lake Data Warehouse Data Quality 52

AWS Big Data

APRIL 3, 2024

Data engineers use Apache Iceberg because it’s fast, efficient, and reliable at any scale and keeps records of how datasets change over time. Apache Iceberg offers integrations with popular data processing frameworks such as Apache Spark, Apache Flink, Apache Hive, Presto, and more.

Data Lake 91

Data Lake Snapshot Metadata Data Architecture 91

Ontotext

AUGUST 22, 2023

Context: The Key to Making Data Useful It goes without saying that data without meaning can yield incorrect insights, leading to potentially dangerous decisions. Beyond that, and without a way to visualize, connect, and utilize the data, it’s still just a bunch of random information.

Metadata 52

Metadata Knowledge Discovery Big Data Enterprise 52

AWS Big Data

OCTOBER 3, 2023

In-place data upgrade In an in-place data migration strategy, existing datasets are upgraded to Apache Iceberg format without first reprocessing or restating existing data. In this method, the metadata are recreated in an isolated environment and colocated with the existing data files. This can save time.

Data Lake 98

Data Lake Metadata Snapshot Recreation/Entertainment 98

AWS Big Data

DECEMBER 13, 2023

In addition to using native managed AWS services that BMS didn’t need to worry about upgrading, BMS was looking to offer an ETL service to non-technical business users that could visually compose data transformation workflows and seamlessly run them on the AWS Glue Apache Spark-based serverless data integration engine.

Metadata 84

Metadata Data Lake Visualization Data Transformation 84

Ontotext

JUNE 27, 2019

Ontotext’s GraphDB is an enterprise-ready semantic graph database (also called RDF triplestore as it stores data in RDF triples). It provides the core infrastructure for solutions where modeling agility, data integration, relationship exploration, cross-enterprise data publishing and consumption are critical.

Metadata 40

Metadata Management Enterprise Optimization 40

Rocket-Powered Data Science

JULY 6, 2021

This is accomplished through tags, annotations, and metadata (TAM). granules) of the data collection for fast search, access, and retrieval is also important for efficient orchestration and delivery of the data that fuels AI, automation, and machine learning operations. Collect, curate, and catalog (i.e.,

Strategy 266

Strategy Machine Learning Metadata Knowledge Discovery 266

DataKitchen

OCTOBER 20, 2023

Example 2: The Data Engineering Team Has Many Small, Valuable Files Where They Need Individual Source File Tracking In a typical data processing workflow, tracking individual files as they progress through various stages—from file delivery to data ingestion—is crucial.

Insurance 176

Insurance Metadata Data-driven Data Quality 176

CIO Business Intelligence

MARCH 24, 2023

The program must introduce and support standardization of enterprise data. Programs must support proactive and reactive change management activities for reference data values and the structure/use of master data and metadata.

Data Governance 142

Data Governance Management Metadata Data Quality 142

Alation

DECEMBER 6, 2022

Diby Malakar joins as our new Vice President of Product Management, Cloud & Technical Metadata Platform and Jonathan Bruce is our new Vice President of Product Management, Catalog, Governance & Data Exploration Apps & Logical Metadata Platform. Oversee the connectors and lineage product areas.

Metadata 52

Metadata Enterprise Data Integration Data Quality 52

erwin

JANUARY 9, 2020

That’s because it’s the best way to visualize metadata , and metadata is now the heart of enterprise data management and data governance/ intelligence efforts. So here’s why data modeling is so critical to data governance. erwin Data Modeler: Where the Magic Happens.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

CIO Business Intelligence

MARCH 4, 2024

This is where data fabric tools with their focus on orchestration, contextual layering, and metadata management are important elements to add to the equation. Data fabric introduces an intelligent semantic layer that orchestrates disparate data sources, applications, and services into a unified and easily accessible framework.

Insurance 98

Insurance Strategy Data Governance Data Integration 98

AWS Big Data

APRIL 29, 2024

Addressing big data challenges – Big data comes with unique challenges, like managing large volumes of rapidly evolving data across multiple platforms. Effective permission management helps tackle these challenges by controlling how data is accessed and used, providing data integrity and minimizing the risk of data breaches.

Management 92

Management Big Data Metadata Data Warehouse 92

Smart Data Collective

JULY 15, 2021

A data catalog serves the same purpose. By using metadata (or short descriptions), data catalogs help companies gather, organize, retrieve, and manage information. You can think of a data catalog as an enhanced Access database or library card catalog system. What Does a Data Catalog Consist Of?

Metadata 127

Metadata IT Data-driven Data Quality 127

Ontotext

DECEMBER 1, 2023

So, KGF 2023 proved to be a breath of fresh air for anyone interested in topics like data mesh and data fabric , knowledge graphs, text analysis , large language model (LLM) integrations, retrieval augmented generation (RAG), chatbots, semantic data integration , and ontology building.

Metadata 78

Metadata Sales Consulting Enterprise 78

AWS Big Data

FEBRUARY 29, 2024

However, enterprise data generated from siloed sources combined with the lack of a data integration strategy creates challenges for provisioning the data for generative AI applications. Data discoverability Unlike structured data, which is managed in well-defined rows and columns, unstructured data is stored as objects.

Data Governance 91

Data Governance Unstructured Data Metadata Data Lake 91

Octopai

FEBRUARY 26, 2024

A Strategic Approach to Data Cleansing With Octopai’s automated data lineage, data cleansing transcends its traditional role, becoming a strategic endeavor that drives efficiency, ensures data integrity, and unlocks business insights.

Metadata 52

Metadata ROI Optimization Data-driven 52

Smarten

JANUARY 30, 2024

Business users cannot even hope to prepare data for analytics – at least not without the right tools. Gartner predicts that, ‘data preparation will be utilized in more than 70% of new data integration projects for analytics and data science.’ So, why is there so much attention paid to the task of data preparation?

Analytics 67

Analytics Data Quality Visualization Metadata 67

erwin

OCTOBER 8, 2020

These tools range from enterprise service bus (ESB) products, data integration tools; extract, transform and load (ETL) tools, procedural code, application program interfaces (APIs), file transfer protocol (FTP) processes, and even business intelligence (BI) reports that further aggregate and transform data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

O'Reilly on Data

JANUARY 29, 2019

These include data integration and extract, transform, and load (ETL) (60% of respondents indicated they were building or evaluating solutions), data preparation and cleaning (52%), data governance (31%), metadata analysis and management (28%), and data lineage management (21%).

Deep Learning 208

Deep Learning Machine Learning Data Science Metadata 208

erwin

MAY 13, 2020

The role of data modeling (DM) has expanded to support enterprise data management, including data governance and intelligence efforts. Metadata management is the key to managing and governing your data and drawing intelligence from it. Types of Data Models: Conceptual, Logical and Physical.

Data Governance 93

Data Governance Modeling Enterprise Management 93

IBM Big Data Hub

JULY 6, 2022

With traditional approaches , data issues are reported by data users as they try to access and use the data and may take weeks to fix, if they’re found at all. starts at the data source, collecting data pipeline metadata across key solutions in the modern data stack like Airflow, dbt, Databricks and many more.

Metadata 57

Metadata Data Quality Snapshot Cost-Benefit 57

erwin

JANUARY 30, 2020

The results of our new research show that organizations are still trying to master data governance, including adjusting their strategies to address changing priorities and overcoming challenges related to data discovery, preparation, quality and traceability. And close to 50 percent have deployed data catalogs and business glossaries.

Data Governance 145

Data Governance Metadata Cost-Benefit Digital Transformation 145

erwin

JANUARY 24, 2019

In most companies, an incredible amount of data flows from multiple sources in a variety of formats and is constantly being moved and federated across a changing system landscape. With an automation framework, data professionals can meet these needs at a fraction of the cost of the traditional manual way. Governing metadata.

Data Governance 71

Data Governance Metadata Data-driven Cost-Benefit 71

Ontotext

SEPTEMBER 15, 2020

Added to this is the increasing demands being made on our data from event-driven and real-time requirements, the rise of business-led use and understanding of data, and the move toward automation of data integration, data and service-level management. Knowledge Graphs are the Warp and Weft of a Data Fabric.

Metadata 69

Metadata Knowledge Discovery Data Quality Strategy 69

IBM Big Data Hub

APRIL 9, 2018

There’s a general need for next-gen executives to not only understand corporate regulations, but be able to adhere to and follow them using metadata solutions like data governance. As the business world’s top asset becomes data, data governance will ensure that data and information being handled is consistent, reliable and trustworthy.

Data Governance 95

Data Governance Metadata Data Integration Analytics 95

IBM Big Data Hub

JULY 13, 2022

This information is then automatically scanned into Watson Knowledge Catalog’s Data Lineage UI and becomes available to view alongside the data quality, business terms, and other metadata previously available to Watson Knowledge Catalog users.

Metadata 65

Metadata Data Governance Data Quality Data Integration 65

Ontotext

JANUARY 26, 2023

The catalog stores the asset’s metadata in RDF. This allows keeping a well-defined representation of the metadata of each asset and enables using a SPARQL endpoint to query it. Towards that end authors introduce a system for integrity checks for building automation applications and using more reliable data for data analytics processes.

Interactive 52

Interactive Metadata Data Integration Data-driven 52

erwin

JANUARY 17, 2020

Data modeling is a process that enables organizations to discover, design, visualize, standardize and deploy high-quality data assets through an intuitive, graphical interface. Data models provide visualization, create additional metadata and standardize data design across the enterprise. SQL or NoSQL?

Data-driven 138

Data-driven Modeling Metadata Data Governance 138

IBM Big Data Hub

NOVEMBER 4, 2022

Increasingly enterprise data is spread across multiple environments which contributes to inconsistent data silos that complicate data governance initiatives and create data integrity issues that could impact Business Intelligence and analytics applications. IBM’s holistic approach to Data Quality.

Data Quality 57

Data Quality Metadata Data Governance Data-driven 57

IBM Big Data Hub

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

Alation

DECEMBER 15, 2022

March 2015: Alation emerges from stealth mode to launch the first official data catalog to empower people in enterprises to easily find, understand, govern and use data for informed decision making that supports the business. May 2016: Alation named a Gartner Cool Vendor in their Data Integration and Data Quality, 2016 report.

Metadata 52

Metadata Data Governance Data Quality Marketing 52

TDAN

DECEMBER 17, 2019

If you do a general internet search for data catalogs, all sorts of possibilities emerge. If you look closely, and ask a lot of questions, you will find that some of these products are not actually fully functional data catalogs at all. Some software products start out life-solving a specific use case related to data, […].

Metadata 52

Metadata Software Data Quality Data Integration 52

IBM Big Data Hub

MAY 9, 2022

These use cases provide a foundation that delivers a rich and intuitive data shopping experience. This data marketplace capability will enable organizations to efficiently deliver high quality governed data products at scale across the enterprise. Multicloud data integration.

Management 57

Management Data Quality Metadata Data Integration 57

Ontotext

JULY 13, 2023

Knowledge graphs have greatly helped to successfully enhance business-critical enterprise applications, especially those where high performance tagging and agile data integration is needed. Enterprises generate an enormous amount of data and content every minute. How can you build knowledge graphs for enterprise applications?

Enterprise 52

Enterprise Metadata Digital Transformation Software 52