TDAN

FEBRUARY 4, 2020

Back in 2017, I wrote an article titled There are No Facts … Without Data. The overwhelmingly positive response to that article validated for me that most people believed my premise to be true. It is time to revisit that topic. I was very thankful to see that. In this anti-fact world (watch cable news […].

Data Quality 59

Data Quality IT Data Governance Metadata 59

TDAN

JUNE 6, 2023

You would think that after knocking around in semantics and knowledge graphs for over two decades I’d have had a pretty good idea about Knowledge Management, but it turns out I didn’t. I think in the rare event the term came up I internally conflated it with Knowledge Graphs and moved on. The first tap […]

Management 97

Management IT Data Architecture Metadata 97

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

MAY 31, 2022

The Titanic set sail on its maiden voyage on April 10, 1912. Four days later on April 14th, the ship collides with a submerged iceberg and sinks in less than three hours. The captain and his crew had insufficient knowledge of the danger that lurked beneath the sea. This lack of awareness led to the […].

IT 59

IT Metadata Data Strategy Data Governance 59

TDAN

SEPTEMBER 15, 2020

In the world of data, automation plays a well-honed role in rapidly developing modern data estates. Before we proceed any further, let’s establish an understanding about the purpose of a corporate data estate. A data estate is the technical architecture and enterprise infrastructure that enables organizations to […].

Enterprise 85

Enterprise Data Architecture Metadata Data Strategy 85

AWS Big Data

JULY 28, 2023

By creating visual representations of data flows, organizations can gain a clear understanding of the lifecycle of personal data and identify potential vulnerabilities or compliance gaps. Note that putting a comprehensive data strategy in place is not in scope for this post.

Snapshot 80

Snapshot Metadata Measurement Data Warehouse 80

TDAN

MAY 31, 2022

One very influential factor that can potentially undermine your data and document strategies is the natural and emotional reactions of people when things change. It is common to take great care in the selection and implementation of new technology.

Testing 52

Testing Interactive Strategy Software 52

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

TDAN

JANUARY 5, 2021

A recent report on data culture released by Alation shows that enterprises continue to make progress toward creating a data culture even while the pandemic has forced them to make tough decisions. More than half of data professionals believe […]. But things are looking up.

Reporting 52

Reporting Enterprise Metadata Data Strategy 52

TDAN

MARCH 19, 2019

Various databases, plus one or more data warehouses, have been the state-of-the art data management infrastructure in companies for years. The emergence of various new concepts, technologies, and applications such as Hadoop, Tableau, R, Power BI, or Data Lakes indicate that changes are under way.

Management 84

Management Data Lake Data Warehouse Analytics 84

Alation

MARCH 21, 2023

To fully realize data’s value, organizations in the travel industry need to dismantle data silos so that they can securely and efficiently leverage analytics across their organizations. What is big data in the travel and tourism industry? Using Alation, ARC automated the data curation and cataloging process. “So

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

TDAN

NOVEMBER 5, 2019

This series of columns will focus on many things including the nature of a graph database, how we evolved to a graph database, how a graph database is different from a relational database, two classes of graph databases – property and semantic, how property and semantic graph databases differ, use cases, challenges, how to map […].

Metadata 40

Metadata Data Strategy Data Architecture Business Intelligence 40

TDAN

MAY 14, 2019

Cross-Agency Priority (CAP) Goal #2 is “leverage data as a strategic asset to grow the economy, increase the effectiveness of the Federal Government, facilitate oversight, and promote transparency.” The President’s Management Agenda (PMA) lays out a long-term vision for modernizing the Federal Government.

Management 40

Management Data Quality Data Architecture Metadata 40

AWS Big Data

MARCH 9, 2023

SCD2 metadata – rec_eff_dt and rec_exp_dt indicate the state of the record. Register source tables in the AWS Glue Data Catalog We use an AWS Glue crawler to infer metadata from delimited data files like the CSV files used in this post. These two columns together define the validity of the record.

Slice and Dice 79

Slice and Dice Data Warehouse Metrics Metadata 79

Domino Data Lab

OCTOBER 9, 2019

Paco Nathan’s latest article covers data practices from the National Oceanic and Atmospheric Administration (NOAA) Environment Data Management (EDM) workshop as well as updates from the AI Conference. Monica Youngman, director of data stewardship—check out her slides for the “Data Archiving at NOAA” keynote.

Deep Learning 69

Deep Learning Metadata Machine Learning Data Science 69

IBM Big Data Hub

AUGUST 4, 2023

When workers get their hands on the right data, it not only gives them what they need to solve problems, but also prompts them to ask, “What else can I do with data?” ” through a truly data literate organization. What is data democratization? What are your data and AI objectives?

Data Architecture 64

Data Architecture Data Lake Machine Learning Data Governance 64

Alation

JULY 6, 2021

Source: Gartner : Adaptive Data and Analytics Governance to Achieve Digital Business Success. As data collection and volume surges, so too does the need for data strategy. As enterprises struggle to juggle all three, data governance offers a vital framework. “Metadata” describes data about the data.

Data Governance 52

Data Governance Metadata Data Quality Risk 52