AWS Big Data

OCTOBER 3, 2023

Over the years, data lakes on Amazon Simple Storage Service (Amazon S3) have become the default repository for enterprise data and are a common choice for a large set of users who query data for a variety of analytics and machine leaning use cases. Analytics use cases on data lakes are always evolving.

Data Lake 98

Data Lake Metadata Snapshot Recreation/Entertainment 98

AWS Big Data

APRIL 26, 2023

Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more. This is a guest blog post co-written with Corey Johnson from Huron.

Metadata 52

Metadata Dashboards Visualization Consulting 52

CIO Business Intelligence

JUNE 23, 2022

In our very own Enterprise Data Maturity research surveying over 3,000 IT and senior business leaders, we found that 40% of organizations are currently running hybrid but mostly on-premises, and 36% of respondents expect to shift to hybrid multi-cloud in the next 18 months. Where data flows, ideas follow.

IT 83

IT Data Architecture Unstructured Data Big Data 83

AWS Big Data

MARCH 10, 2023

However, as data processing at scale solutions grow, organizations need to build more and more features on top of their data lakes. They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing.

Data Lake 98

Data Lake Sales Data Warehouse Snapshot 98

TDAN

MAY 3, 2022

The road to creating business value through a well-oiled data management strategy can be long and challenging. A successful data management strategy is one that generates value rapidly and unlocks new data-driven insights.

Analytics 52

Analytics Data-driven Strategy Management 52

Data Virtualization

MARCH 3, 2021

Data is the fuel of the digital economy, so data-centric organizations have a distinct advantage. To remain competitive, organizations must have a data management strategy in place to effectively ingest, store, organize, and analyze data while ensuring that it is.

Enterprise 75

Enterprise Management Strategy Data Lake 75

Data Virtualization

MARCH 3, 2021

Data is the fuel of the digital economy, so data-centric organizations have a distinct advantage. To remain competitive, organizations must have a data management strategy in place to effectively ingest, store, organize, and analyze data while ensuring that it is.

Management 59

Management Enterprise Strategy IT 59

Data Virtualization

MARCH 3, 2021

Data is the fuel of the digital economy, so data-centric organizations have a distinct advantage. To remain competitive, organizations must have a data management strategy in place to effectively ingest, store, organize, and analyze data while ensuring that it is.

Management 52

Management Enterprise Strategy IT 52

AWS Big Data

AUGUST 31, 2023

Amazon Redshift is a fast, fully managed petabyte-scale cloud data warehouse that makes it simple and cost-effective to analyze all your data using standard SQL and your existing business intelligence (BI) tools. Iceberg stores the metadata pointer for all the metadata files.

Data Lake 89

Data Lake Data Warehouse Metadata Data Architecture 89

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

Sisense

JULY 6, 2020

First off, this involves defining workflows for every business process within the enterprise: the what, how, why, who, when, and where aspects of data. Its main purpose is to establish an enterprise data management strategy. Data security is also a part of this field. Benefits of enterprise data management.

Enterprise 98

Enterprise Management Data Architecture Strategy 98

TDAN

MARCH 31, 2020

yield differing answers, making it more difficult to run the business. Executive Summary It seems obvious enough that companies, government agencies and non-profits would benefit from a common language. Without it, coordinating work is more difficult, computers “don’t talk,” and basic questions such as “how many customers do we have?”

IT 84

IT Data Architecture Metadata Data Strategy 84

TDAN

SEPTEMBER 15, 2020

Remember the Sears catalog? Hundreds of pages of clothes quickly flipped past to get to the toys! Who didn’t spend countless hours trying to find the perfect suggested gift for your next birthday or holiday? In an Amazon and eBay world, thinking about old-school catalogs seems so quaint. Opening a paper volume to manually flip […].

Data Architecture 69

Data Architecture Metadata Data Strategy Data Governance 69

Jen Stirrup

MARCH 29, 2023

What does a sound, intelligent data foundation give you? It can give business-oriented data strategy for business leaders to help drive better business decisions and ROI. It can also increase productivity by enabling the business to find the data they need when the business teams need it.

Metadata 120

Metadata Data Warehouse Data Integration Business Intelligence 120

Alation

APRIL 14, 2022

In today’s AI/ML-driven world of data analytics, explainability needs a repository just as much as those doing the explaining need access to metadata, EG, information about the data being used. The Cloud Data Migration Challenge. On-premises business intelligence and databases. Cloud governance.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

CIO Business Intelligence

JANUARY 30, 2024

Even for more straightforward ESG information, such as kilowatt-hours of energy consumed, ESG reporting requirements call for not just the data, but the metadata, including “the dates over which the data was collected and the data quality,” says Fridrich. Approach strategy development in small increments.

Reporting 107

Reporting Data Quality Strategy Data-driven 107

TDAN

JULY 2, 2019

The third and final part of the Non-Invasive Data Governance Framework details the breakdown of components by level, providing considerations for what must be included at the intersections. The squares are completed with nouns and verbs that provide direction for meaningful discussions about how the program will be set up and operate.

Data Governance 74

Data Governance Data Quality Data Architecture Metadata 74

TDAN

MARCH 17, 2020

Business has a fundamental problem with data quality. In some places it’s merely painful, in others it’s nearly catastrophic. Why is the problem so pervasive? Why does it never seem to get fixed? I believe we’ve been thinking about the problem wrong. It’s time for a fresh look.

Data Quality 59

Data Quality Data Architecture IT Metadata 59

CIO Business Intelligence

MARCH 9, 2022

They conveniently store data in a flat architecture that can be queried in aggregate and offer the speed and lower cost required for big data analytics. On the other hand, they don’t support transactions or enforce data quality. Ready to evolve your analytics strategy or improve your data quality?

Data Lake 109

Data Lake Unstructured Data Data Warehouse Data Quality 109

AWS Big Data

NOVEMBER 29, 2023

In 2013, Amazon Web Services revolutionized the data warehousing industry by launching Amazon Redshift , the first fully-managed, petabyte-scale, enterprise-grade cloud data warehouse. Amazon Redshift made it simple and cost-effective to efficiently analyze large volumes of data using existing business intelligence tools.

Data Warehouse 97

Data Warehouse Data Lake Analytics Machine Learning 97

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale. Iceberg offers a Merge On Read strategy to enable fast writes.

Data Lake 109

Data Lake Metadata Optimization Statistics 109

TDAN

MAY 14, 2019

Welcome to DAMA Corner, a source of information for data management professionals here in TDAN.com, an industry-leading publication for people interested in learning about data administration, data management disciplines, and best practices.

Management 40

Management Data Quality Data Architecture Metadata 40

TDAN

NOVEMBER 5, 2019

This series of columns will focus on many things including the nature of a graph database, how we evolved to a graph database, how a graph database is different from a relational database, two classes of graph databases – property and semantic, how property and semantic graph databases differ, use cases, challenges, how to map […].

Metadata 40

Metadata Data Strategy Data Architecture Business Intelligence 40

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. These data pipelines generate valuable insights and curated data that are stored in Apache Iceberg tables for downstream usage.

Data Lake 84

Data Lake Analytics Snapshot Optimization 84

IBM Big Data Hub

AUGUST 4, 2023

Today, the way businesses use data is much more fluid; data literate employees use data across hundreds of apps, analyze data for better decision-making, and access data from numerous locations. It uses knowledge graphs, semantics and AI/ML technology to discover patterns in various types of metadata.

Data Architecture 62

Data Architecture Data Lake Machine Learning Data Governance 62

Jet Global

MAY 1, 2023

Learn how embedded analytics are different from traditional business intelligence and what analytics users expect. Embedded Analytics Definition Embedded analytics are the integration of analytics content and capabilities within applications, such as business process applications (e.g., that gathers data from many sources.

Analytics 52

Analytics Cost-Benefit Visualization Dashboards 52