article thumbnail

ETL Antipattern: Lazy Metadata

Tim Mitchell

If data is a train, then metadata is the track on which it travels. A good metadata definition in ETL processes will help to ensure that the flow of the data is predictable, robust, and is properly constrained to avoid errors. However, many ETL processes take a hands-off approach when it comes to metadata.

article thumbnail

What is Metadata Management?

Octopai

Modern data processing depends on metadata management to power enhanced business intelligence. Metadata is of course the information about the data, and the process of managing it is mysterious to those not trained in advanced BI. In this article, you will learn: What does metadata management do? What is metadata management?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Three’s Company Too: Metadata, Data and Text Analysis

Ontotext

Metadata used to be a secret shared between system programmers and the data. Metadata described the data in terms of cardinality, data types such as strings vs integers, and primary or foreign key relationships. Inevitably, the information that could and needed to be expressed by metadata increased in complexity.

article thumbnail

Data Management 20/20: Anatomy of a Business Glossary Definition

TDAN

Standards exist for naming conventions, abbreviations and other pertinent metadata properties. Consistent business meaning is important because distinctions between business terms are not typically well defined or documented. What are the standards for writing […].

article thumbnail

The Future of Data Lineage and the Role of Metadata

Alation

It’s important to realize that we need visibility into lineage and relationships between all data and data-related assets, including business terms, metric definitions, policies, quality rules, access controls, algorithms, etc. Active metadata will play a critical role in automating such updates as they arise. Why Focus on Lineage?

article thumbnail

You Don’t Know Data! (The Importance of Sound Definitions)

TDAN

Edwards Deming, the father of statistical quality control, said: “If you can’t describe what you are doing as a process, you don’t know what you’re doing.” When looking at the world of IT and applied to the dichotomy of software and data, Deming’s quote applies to the software part of that pair. The analogous […]

article thumbnail

Gartner Magic Quadrant for Metadata Management Includes Alation

Alation

Gartner predicts that “By 2020, 50% of information governance initiatives will be enacted with policies based on metadata alone.”. Magic Quadrant for Metadata Management Solutions , Guido de Simoni and Roxane Edjlali, August 10, 2017. Metadata management no longer refers to a static technical repository. – Gartner, Inc.,