AWS Big Data

MARCH 25, 2024

Change data capture (CDC) events contain information about the source record, updates, and metadata such as time, source, classification (insert, update, or delete), and the initiator of the change. The following diagram illustrates an example workflow for CDC streaming ingestion and processing for unified customer profiles.

Data Lake 90

Data Lake Unstructured Data Management Modeling 90

AWS Big Data

NOVEMBER 16, 2023

Each record in a hub table is married with metadata that identifies the record’s creation time, originating source system, and unique business key. Some customers run their BDV processing once a day, so a pause/resume window for Redshift provisioned cluster may be cost beneficial here. Data Vault 2.0

Enterprise 85

Enterprise Data Warehouse Data Lake Optimization 85

AWS Big Data

JUNE 14, 2023

As a team of engineers focused on building a single source of truth within Amazon, we wanted a BI tool that was cost-effective, secure, and integrated seamlessly with the other AWS services we use. The teams we serve have benefited from our switch to QuickSight. We also helped 13 Amazon teams to set up their own instances.

Dashboards 76

Dashboards KPI Scorecard Metadata 76

AWS Big Data

AUGUST 14, 2023

By leaning into these teams and showing value through them first, then using them as evangelists, organizations can gain maturity while benefitting earlier from the advantages of data mesh strategies. Acts as steering body for the governance of DPPM as a practice (KPI monitoring, maturity assessments, auditing, and so on).

Management 79

Management Risk Measurement Optimization 79