2023, Data Analytics, Data Architecture and Snapshot

Implement slowly changing dimensions in a data lake using AWS Glue and Delta

AWS Big Data

MARCH 28, 2023

This post is designed to be implemented for a real customer use case, where you get full snapshot data on a daily basis. employee" where delete_flag=true and date_format(CAST(end_date AS date),'%Y/%m') ='2023/03' Note: Update the correct database name from the CloudFormation output before running the above query.

Data Lake

Data Lake Testing Snapshot Sales

A Summary Of Gartner’s Recent Innovation Insight Into Data Observability

DataKitchen

AUGUST 8, 2023

On 20 July 2023, Gartner released the article “ Innovation Insight: Data Observability Enables Proactive Data Quality ” by Melody Chien. It alerts data and analytics leaders to issues with their data before they multiply. Are problems with data tests? Which report tab is wrong? When did it last run?

Data Quality

Data Quality Testing Snapshot Reporting

Data Leaders Brief

Implement slowly changing dimensions in a data lake using AWS Glue and Delta

A Summary Of Gartner’s Recent Innovation Insight Into Data Observability

Webinars

Stay Connected