2022 and Blog - Data Leaders Brief

Build incremental data pipelines to load transactional data changes using AWS DMS, Delta 2.0, and Amazon EMR Serverless

AWS Big Data

MARCH 3, 2023

A solution to this problem is to use AWS Database Migration Service (AWS DMS) for migrating historical and real-time transactional data into the data lake. We then apply transformations using Spark jobs on an EMR Serverless application and write transformed output into open-source Delta tables in Amazon S3.

Data Lake

Data Lake Dashboards Metrics Metadata

Simplify data loading into Type 2 slowly changing dimensions in Amazon Redshift

AWS Big Data

MARCH 9, 2023

In this post, we show how to simplify data loading into a Type 2 slowly changing dimension in Amazon Redshift. Organizations create data marts , which are subsets of the data warehouse and usually oriented for gaining analytical insights specific to a business unit or team. The star schema is a popular data model for building data marts.

Slice and Dice

Slice and Dice Data Warehouse Metrics Metadata

Data Leaders Brief

Build incremental data pipelines to load transactional data changes using AWS DMS, Delta 2.0, and Amazon EMR Serverless

Simplify data loading into Type 2 slowly changing dimensions in Amazon Redshift

Webinars

Stay Connected