AWS Big Data

APRIL 25, 2024

Amazon Managed Workflows for Apache Airflow (Amazon MWAA) is a managed orchestration service for Apache Airflow that you can use to set up and operate data pipelines in the cloud at scale. The data engineering team wants to separate the raw data into its own AWS account (Account B in the diagram) for increased security and control.

Metadata 101

Metadata Data Processing Management Testing 101

AWS Big Data

AUGUST 16, 2023

Automated Data Analytics (ADA) on AWS is an AWS solution that enables you to derive meaningful insights from data in a matter of minutes through a simple and intuitive user interface. ADA offers an AWS-native data analytics platform that is ready to use out of the box by data analysts for a variety of use cases.

Data Analytics 72

Data Analytics Analytics Visualization Software 72

Cloudera

APRIL 23, 2021

Introduction: Encryption of Data at Rest is a highly desirable or sometimes mandatory requirement for data platforms in a range of industry verticals including HealthCare, Financial & Government organizations. HDFS Encryption prevents access to clear text data. Each HDFS file is encrypted using an encryption key.

Data Processing 68

Data Processing Metadata Testing Management 68

AWS Big Data

MARCH 21, 2024

In this post, we provide step-by-step guidance on how to get started with near real-time operational analytics using this feature. The extract, transform, and load (ETL) process has been a common pattern for moving data from an operational database to an analytics data warehouse.

Data Warehouse 83

Data Warehouse Metrics Statistics Optimization 83