erwin

FEBRUARY 28, 2024

While the essence of success in data governance is people and not technology, having the right tools at your fingertips is crucial. Technology is an enabler, and for data governance this is essentially having an excellent metadata management tool. Next to data governance, data architecture is really embedded in our DNA.

Metadata 52

Metadata Data Governance Data Quality Technology 52

Cloudera

SEPTEMBER 15, 2022

The consumption of the data should be supported through an elastic delivery layer that aligns with demand, but also provides the flexibility to present the data in a physical format that aligns with the analytic application, ranging from the more traditional data warehouse view to a graph view in support of relationship analysis.

Data Lake 80

Data Lake Data Architecture Data-driven Data Warehouse 80

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. The File Manager Lambda function consumes those messages, parses the metadata, and inserts the metadata to the DynamoDB table odpf_file_tracker.

Data Lake 87

Data Lake Data Processing Metadata Snapshot 87

Alation

JULY 28, 2022

It’s costly and time-consuming to manage on-premises data warehouses — and modern cloud data architectures can deliver business agility and innovation. However, CIOs declare that agility, innovation, security, adopting new capabilities, and time to value — never cost — are the top drivers for cloud data warehousing.

Data Warehouse 69

Data Warehouse Cost-Benefit Data Governance Data-driven 69

AWS Big Data

MARCH 3, 2023

spark_travel_details" limit 10; The table (native Delta table) has been created and updated to the AWS Glue Data Catalog from the EMR Serverless application code. Athena supports reading native Delta tables and therefore we can read the data successfully even though the Data Catalog shows only a single array column.

Data Lake 79

Data Lake Dashboards Metrics Metadata 79

IBM Big Data Hub

JANUARY 18, 2023

They defined it as : “ A data lakehouse is a new, open data management architecture that combines the flexibility, cost-efficiency, and scale of data lakes with the data management and ACID transactions of data warehouses, enabling business intelligence (BI) and machine learning (ML) on all data. ”.

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

Alation

JANUARY 25, 2022

Data Fabric: A Love Story , we defined data fabric and outlined its uses and motivations. As a reminder, here’s Gartner’s definition of data fabric: “A design concept that serves as an integrated layer (fabric) of data and connecting processes. The data catalog is a foundational layer of the data fabric.

Metadata 52

Metadata IT Metrics Data-driven 52

Alation

APRIL 14, 2022

In today’s AI/ML-driven world of data analytics, explainability needs a repository just as much as those doing the explaining need access to metadata, EG, information about the data being used. The Cloud Data Migration Challenge. It’s not a simple definition. Legacy data adds to the challenge. Scheduling.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

Jet Global

MAY 1, 2023

Introduction Why should I read the definitive guide to embedded analytics? The Definitive Guide to Embedded Analytics is designed to answer any and all questions you have about the topic. It is now most definitely a need-to-have. These sit on top of data warehouses that are strictly governed by IT departments.

Analytics 52

Analytics Cost-Benefit Visualization Dashboards 52

IBM Big Data Hub

JULY 5, 2023

Open data formats that kept the data accessible by all but optimized for high performance and with a well-defined structure. Open (sharable) metadata that enables multiple consumption engines or frameworks. Ability to update data (ACID properties) and support transactional concurrency.

Data Lake 65

Data Lake Metadata Cost-Benefit Data Warehouse 65