AWS Big Data

JANUARY 17, 2024

With Amazon EMR 6.15, we launched AWS Lake Formation based fine-grained access controls (FGAC) on Open Table Formats (OTFs), including Apache Hudi, Apache Iceberg, and Delta lake. Many large enterprise companies seek to use their transactional data lake to gain insights and improve decision-making.

Data Lake 89

Data Lake Snapshot Big Data Data-driven 89

AWS Big Data

AUGUST 16, 2023

Apache Iceberg is an open table format for large datasets in Amazon Simple Storage Service (Amazon S3) and provides fast query performance over large tables, atomic commits, concurrent writes, and SQL-compatible table evolution. You can then provide one or multiple S3 paths where the Iceberg tables are located.

Data Lake 74

Data Lake Metadata Snapshot Management 74

Cloudera

SEPTEMBER 11, 2020

Data-at-rest encryption. Transparent data-at-rest encryption is available through the Transparent Data Encryption (TDE) feature in HDFS. . TDE provides the following features: Transparent, end-to-end encryption of data. Both Apache Phoenix and Apache HBase (Web UIs, Thrift Server and REST Server) support Auto-TLS. .

Management 65

Management Big Data Testing Data Integration 65

AWS Big Data

SEPTEMBER 25, 2023

With Amazon Redshift , you can run a complex mix of workloads on your data warehouse, such as frequent data loads running alongside business-critical dashboard queries and complex transformation jobs. We also see more and more data science and machine learning (ML) workloads. ExampleCorp has multiple Redshift clusters.

Management 91

Management Data Warehouse Metrics Dashboards 91

AWS Big Data

NOVEMBER 8, 2023

Amazon SageMaker Studio is a fully integrated development environment (IDE) for machine learning (ML) that enables data scientists and developers to perform every step of the ML workflow, from preparing data to building, training, tuning, and deploying models. No customer data is required.

Testing 83

Testing Modeling Management Machine Learning 83

AWS Big Data

OCTOBER 31, 2023

Customers rely on data from different sources such as mobile applications, clickstream events from websites, historical data, and more to deduce meaningful patterns to optimize their products, services, and processes. Apache Airflow and Snowflake have emerged as powerful technologies for data management and analysis.

Data Processing 86

Data Processing Management Publishing Testing 86

AWS Big Data

MAY 30, 2023

Customers have been using data warehousing solutions to perform their traditional analytics tasks. Recently, data lakes have gained lot of traction to become the foundation for analytical solutions, because they come with benefits such as scalability, fault tolerance, and support for structured, semi-structured, and unstructured datasets.

Data Lake 76

Data Lake Data Analytics Analytics Data Processing 76