AWS Big Data

APRIL 19, 2023

We took this a step further by creating a blueprint to create smart recommendations by linking similar data products using graph technology and ML. In this post, we showed how an organization can augment a data catalog with additional metadata by using ML and Neptune with an automated process. His Amazon author page

Technology 85

Technology Data-driven Machine Learning Sales 85

Domino Data Lab

OCTOBER 9, 2019

Paco Nathan’s latest article covers data practices from the National Oceanic and Atmospheric Administration (NOAA) Environment Data Management (EDM) workshop as well as updates from the AI Conference. Monica Youngman, director of data stewardship—check out her slides for the “Data Archiving at NOAA” keynote.

Deep Learning 69

Deep Learning Metadata Machine Learning Data Science 69

Domino Data Lab

APRIL 3, 2019

This month’s article features updates from one of the early data conferences of the year, Strata Data Conference – which was held just last week in San Francisco. In particular, here’s my Strata SF talk “Overview of Data Governance” presented in article form. In other words, #adulting. Cynical Perspectives.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

IBM Big Data Hub

AUGUST 4, 2023

When workers get their hands on the right data, it not only gives them what they need to solve problems, but also prompts them to ask, “What else can I do with data?” ” through a truly data literate organization. What is data democratization? What are your data and AI objectives?

Data Architecture 62

Data Architecture Data Lake Machine Learning Data Governance 62

TDAN

APRIL 6, 2021

There is an ever-increasing awareness of concerns about data privacy, corporate data breaches, increasing demands for regulatory compliance. There are also emerging concerns about the ways that big data analytics potentially influence and bias automated decision-making.

Risk Management 64

Risk Management Risk Management Big Data 64

TDAN

FEBRUARY 4, 2020

Back in 2017, I wrote an article titled There are No Facts … Without Data. The overwhelmingly positive response to that article validated for me that most people believed my premise to be true. It is time to revisit that topic. I was very thankful to see that. In this anti-fact world (watch cable news […].

Data Quality 59

Data Quality IT Data Governance Metadata 59

AWS Big Data

MARCH 9, 2023

SCD2 metadata – rec_eff_dt and rec_exp_dt indicate the state of the record. Register source tables in the AWS Glue Data Catalog We use an AWS Glue crawler to infer metadata from delimited data files like the CSV files used in this post. These two columns together define the validity of the record.

Slice and Dice 84

Slice and Dice Data Warehouse Metrics Metadata 84

TDAN

JUNE 6, 2023

You would think that after knocking around in semantics and knowledge graphs for over two decades I’d have had a pretty good idea about Knowledge Management, but it turns out I didn’t. I think in the rare event the term came up I internally conflated it with Knowledge Graphs and moved on. The first tap […]

Management 97

Management IT Data Architecture Metadata 97

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

MAY 31, 2022

The Titanic set sail on its maiden voyage on April 10, 1912. Four days later on April 14th, the ship collides with a submerged iceberg and sinks in less than three hours. The captain and his crew had insufficient knowledge of the danger that lurked beneath the sea. This lack of awareness led to the […].

IT 59

IT Metadata Data Strategy Data Governance 59

TDAN

SEPTEMBER 15, 2020

In the world of data, automation plays a well-honed role in rapidly developing modern data estates. Before we proceed any further, let’s establish an understanding about the purpose of a corporate data estate. A data estate is the technical architecture and enterprise infrastructure that enables organizations to […].

Enterprise 85

Enterprise Data Architecture Metadata Data Strategy 85

TDAN

MAY 31, 2022

One very influential factor that can potentially undermine your data and document strategies is the natural and emotional reactions of people when things change. It is common to take great care in the selection and implementation of new technology.

Testing 52

Testing Interactive Strategy Software 52

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

TDAN

JANUARY 5, 2021

A recent report on data culture released by Alation shows that enterprises continue to make progress toward creating a data culture even while the pandemic has forced them to make tough decisions. More than half of data professionals believe […]. But things are looking up.

Reporting 52

Reporting Enterprise Metadata Data Strategy 52

TDAN

MARCH 19, 2019

Various databases, plus one or more data warehouses, have been the state-of-the art data management infrastructure in companies for years. The emergence of various new concepts, technologies, and applications such as Hadoop, Tableau, R, Power BI, or Data Lakes indicate that changes are under way.

Management 84

Management Data Lake Data Warehouse Analytics 84

TDAN

NOVEMBER 5, 2019

This series of columns will focus on many things including the nature of a graph database, how we evolved to a graph database, how a graph database is different from a relational database, two classes of graph databases – property and semantic, how property and semantic graph databases differ, use cases, challenges, how to map […].

Metadata 40

Metadata Data Strategy Data Architecture Business Intelligence 40

TDAN

MAY 14, 2019

Cross-Agency Priority (CAP) Goal #2 is “leverage data as a strategic asset to grow the economy, increase the effectiveness of the Federal Government, facilitate oversight, and promote transparency.” The President’s Management Agenda (PMA) lays out a long-term vision for modernizing the Federal Government.

Management 40

Management Data Quality Data Architecture Metadata 40