TDAN

JULY 20, 2021

They use data better. How does Spotify win against a competitor like Apple? Using machine learning and AI, Spotify creates value for their users by providing a more personalized experience.

Metadata 119

Metadata Machine Learning Data Architecture Data Strategy 119

TDAN

MAY 31, 2022

The main goal of creating an enterprise data fabric is not new. It is the ability to deliver the right data at the right time, in the right shape, and to the right data consumer, irrespective of how and where it is stored. Data fabric is the common “net” that stitches integrated data from multiple data […].

Metadata 98

Metadata Enterprise IT Data Architecture 98

Cloudera

JUNE 7, 2022

In our very own Enterprise Data Maturity research surveying over 3,000 IT and senior business leaders, we found that 40% of organizations are currently running hybrid but mostly on-premises, and 36% of respondents expect to shift to hybrid multi-cloud in the next 18 months. Where data flows, ideas follow.

IT 108

IT Data Architecture Unstructured Data Big Data 108

CIO Business Intelligence

JUNE 23, 2022

In our very own Enterprise Data Maturity research surveying over 3,000 IT and senior business leaders, we found that 40% of organizations are currently running hybrid but mostly on-premises, and 36% of respondents expect to shift to hybrid multi-cloud in the next 18 months. Where data flows, ideas follow. Jonathan Takiff / IDG.

IT 90

IT Data Architecture Unstructured Data Big Data 90

Jen Stirrup

MARCH 29, 2023

What does a sound, intelligent data foundation give you? It can give business-oriented data strategy for business leaders to help drive better business decisions and ROI. It can also increase productivity by enabling the business to find the data they need when the business teams need it.

Metadata 120

Metadata Data Warehouse Data Integration Business Intelligence 120

Cloudera

JANUARY 5, 2023

Data contains valuable insights for critical business decision-making, and the most innovative and successful organizations recognize data as a strategic resource that demands its own strategy. How this strategy looks depends on the organization’s unique business needs as one affects the other.

Cost-Benefit 52

Cost-Benefit Business Objectives Machine Learning Data Architecture 52

AWS Big Data

APRIL 26, 2023

Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more. This is a guest blog post co-written with Corey Johnson from Huron.

Metadata 52

Metadata Dashboards Visualization Consulting 52

Cloudera

JULY 20, 2021

Once companies are able to leverage their data they’re then able to fuel machine learning and analytics models, transforming their business by embedding AI into every aspect of their business. . Build your data strategy around the convergence of software and hardware.

Manufacturing 102

Manufacturing Forecasting IoT Insurance 102

Alation

APRIL 19, 2021

With a good plan and a modern data catalog, you can minimize the time and cost of cloud migration. Source: Webinar with data expert Ibby Rahmani: Emerging Trends in Data Architecture: What’s the Next Big Thing? Alation & Global Data Strategy). Creating A Cloud Migration Strategy.

Cost-Benefit 111

Cost-Benefit Strategy Enterprise Data Strategy 111

AWS Big Data

APRIL 19, 2023

Independent data products often only have value if you can connect them, join them, and correlate them to create a higher order data product that creates additional insights. A modern data architecture is critical in order to become a data-driven organization.

Technology 80

Technology Data-driven Machine Learning Sales 80

AWS Big Data

JULY 14, 2023

These inputs reinforced the need of a unified data strategy across the FinOps teams. We decided to build a scalable data management product that is based on the best practices of modern data architecture. This global catalog captures new or updated partitions from the data producer AWS Glue Data Catalogs.

Finance 81

Finance Metadata Big Data Recreation/Entertainment 81

AWS Big Data

MARCH 10, 2023

They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. These transactional data lakes combine features from both the data lake and the data warehouse. One important aspect to a successful data strategy for any organization is data governance.

Data Lake 100

Data Lake Sales Data Warehouse Snapshot 100

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. The File Manager Lambda function consumes those messages, parses the metadata, and inserts the metadata to the DynamoDB table odpf_file_tracker.

Data Lake 89

Data Lake Data Processing Metadata Snapshot 89

AWS Big Data

APRIL 3, 2024

If the asset has AWS Glue Data Quality enabled, you can now quickly visualize the data quality score directly in the catalog search pane. By selecting the corresponding asset, you can understand its content through the readme, glossary terms , and technical and business metadata.

Data Quality 87

Data Quality Visualization Metadata Metrics 87

AWS Big Data

JANUARY 31, 2023

In this post, we are excited to summarize the features that the AWS Glue Data Catalog, AWS Glue crawler, and Lake Formation teams delivered in 2022. Whether you are a data platform builder, data engineer, data scientist, or any technology leader interested in data lake solutions, this post is for you.

Data Lake 80

Data Lake Data Governance Data Architecture Machine Learning 80

TDAN

DECEMBER 3, 2019

I said I thought it affected all of them pretty profoundly, but perhaps the Metadata wedge the most. Recently, I was giving a presentation and someone asked me which segment of “the DAMA wheel” did I think semantics most affected. I thought I’d spend a bit of time to reflect on the question and answer […].

Metadata 88

Metadata Data Architecture IT Data Strategy 88

Cloudera

AUGUST 21, 2020

To find out more about how live-streaming data might impact the sector I sat down for a chat with Dinesh Chandrasekhar , Head of Product Marketing in Cloudera’s data-in-motion Business Unit. To start off, what are the advantages of a forward-looking data-in-motion strategy?

Enterprise 59

Enterprise Data Lake Strategy Metadata 59

TDAN

JULY 19, 2022

In reference to the prior column on enterprise data management and high level lego framework, this column reviews in detail the foundational layer of Organization Mission, Level 1. These six lego blocks […].

Strategy 52

Strategy Enterprise Management Modeling 52

TDAN

MAY 31, 2022

In my September 2020 Data is Risky Business column for TDAN.com, I wrote about the strategy lessons for data that we can learn from the writings of a 16thcentury Japanese swordsman. To summarize: – We need to study different disciplines to understand how they relate to each other.

Strategy 52

Strategy Data Architecture Data Strategy Metadata 52

TDAN

MAY 31, 2022

One very influential factor that can potentially undermine your data and document strategies is the natural and emotional reactions of people when things change. It is common to take great care in the selection and implementation of new technology.

Testing 52

Testing Interactive Strategy Software 52

Alation

MAY 31, 2023

This means that specialized roles such as data architects, which focus on modernizing data architecture to help meet business goals, are increasingly important to support data governance. What is a data architect? Their broad range of responsibilities include: Design and implement data architecture.

Data Governance 52

Data Governance Metadata Data Architecture Data Quality 52

TDAN

JUNE 6, 2023

You would think that after knocking around in semantics and knowledge graphs for over two decades I’d have had a pretty good idea about Knowledge Management, but it turns out I didn’t. I think in the rare event the term came up I internally conflated it with Knowledge Graphs and moved on. The first tap […]

Management 97

Management IT Data Architecture Metadata 97

AWS Big Data

OCTOBER 25, 2023

But most important of all, the assumed dormant value in the unstructured data is a question mark, which can only be answered after these sophisticated techniques have been applied. Therefore, there is a need to being able to analyze and extract value from the data economically and flexibly. The solution integrates data in three tiers.

Unstructured Data 117

Unstructured Data Metadata Management Analytics 117

TDAN

APRIL 5, 2022

Data Governance is defined as the execution and enforcement of authority over the management of data and data-related assets.1 1 The terms “Data Mesh” and “Data Fabric” are the most recent examples of names being given to something that describes techniques to help organizations manage their data.

Data Governance 98

Data Governance Management Data Architecture Metadata 98

TDAN

AUGUST 17, 2021

It has been an incredible run. I hope it is just “see you soon” rather than “goodbye.” With this column, DAMA International’s streak of quarterly columns since mid-2001 is coming to an end. The columns have featured the activities and incredible work of DAMA International over the past two decades. Thank you, DAMA, and I […].

IT 105

IT Data Architecture Metadata Data Strategy 105

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

DECEMBER 6, 2022

The FAIR principles for data sets are gaining traction, especially in the pharmaceutical industry in Europe. In a world of exponential data growth and ever-increasing silo-ization, the FAIR principles are needed more than ever. FAIR stands for: Findable, Accessible, Interoperable and Reusable.

Data Architecture 52

Data Architecture Metadata Data Strategy Strategy 52

TDAN

SEPTEMBER 16, 2020

Differences in Terminology and Capability Building on the terms and concepts introduced in Part I of this white paper, Part II digs deeper into the difference in the meaning of some key terms used in both Property Graphs and Knowledge Graphs, including LABELS, TYPES, and PROPERTIES. Key terms such as these actually mean very different […].

Data Architecture 92

Data Architecture Metadata Data Strategy Strategy 92

TDAN

SEPTEMBER 15, 2020

In the world of data, automation plays a well-honed role in rapidly developing modern data estates. Before we proceed any further, let’s establish an understanding about the purpose of a corporate data estate. A data estate is the technical architecture and enterprise infrastructure that enables organizations to […].

Enterprise 85

Enterprise Data Architecture Metadata Data Strategy 85

TDAN

MARCH 31, 2020

Executive Summary It seems obvious enough that companies, government agencies and non-profits would benefit from a common language. Without it, coordinating work is more difficult, computers “don’t talk,” and basic questions such as “how many customers do we have?” yield differing answers, making it more difficult to run the business.

IT 84

IT Data Architecture Metadata Data Strategy 84

Sisense

JULY 6, 2020

First off, this involves defining workflows for every business process within the enterprise: the what, how, why, who, when, and where aspects of data. Its main purpose is to establish an enterprise data management strategy. Data security is also a part of this field. And the result is, nobody does.”.

Enterprise 98

Enterprise Management Data Architecture Strategy 98

TDAN

SEPTEMBER 15, 2020

Remember the Sears catalog? Hundreds of pages of clothes quickly flipped past to get to the toys! Who didn’t spend countless hours trying to find the perfect suggested gift for your next birthday or holiday? In an Amazon and eBay world, thinking about old-school catalogs seems so quaint. Opening a paper volume to manually flip […].

Data Architecture 69

Data Architecture Metadata Data Strategy Data Governance 69

Data Virtualization

NOVEMBER 17, 2022

Reading Time: 5 minutes Today, many applications call themselves “data catalogs.” The idea seems, on the face of it, easy to understand: a data catalog is simply a centralized inventory of the data assets within an organization. Data catalogs also seek to be the.

Data Integration 59

Data Integration Management Data Lake IT 59

TDAN

DECEMBER 3, 2019

Wherever we go, we are overwhelmed by MORE: more sales, more discounts, more fun, more excitement, more features – the list goes on and on! What humans seem to be far less attuned to is reducing what we don’t need. Drive around any suburban neighborhood and see the many cars parked outside their garages! Believe […].

Sales 78

Sales Data Architecture Data Governance Metadata 78

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

TDAN

JULY 2, 2019

The third and final part of the Non-Invasive Data Governance Framework details the breakdown of components by level, providing considerations for what must be included at the intersections. The squares are completed with nouns and verbs that provide direction for meaningful discussions about how the program will be set up and operate.

Data Governance 74

Data Governance Data Quality Data Architecture Metadata 74

TDAN

MARCH 17, 2020

Business has a fundamental problem with data quality. In some places it’s merely painful, in others it’s nearly catastrophic. Why is the problem so pervasive? Why does it never seem to get fixed? I believe we’ve been thinking about the problem wrong. It’s time for a fresh look. The central flaw in the long-running discussion […].

Data Quality 59

Data Quality Data Architecture IT Metadata 59