Remove Cost-Benefit Remove Data Processing Remove Data Transformation Remove Structured Data
article thumbnail

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS

AWS Big Data

Spark SQL is an Apache Spark module for structured data processing. host') export PASSWORD=$(aws secretsmanager get-secret-value --secret-id $secret_name --query SecretString --output text | jq -r '.password') Melody Yang is a Senior Big Data Solutions Architect for Amazon EMR at AWS. or later installed.

article thumbnail

How smava makes loans transparent and affordable using Amazon Redshift Serverless

AWS Big Data

The data volume is in double-digit TBs with steady growth as business and data sources evolve. smava’s Data Platform team faced the challenge to deliver data to stakeholders with different SLAs, while maintaining the flexibility to scale up and down while staying cost-efficient.