Cloudera

APRIL 3, 2023

In this blog, we will share with you in detail how Cloudera integrates core compute engines including Apache Hive and Apache Impala in Cloudera Data Warehouse with Iceberg. We will publish follow up blogs for other data services. Iceberg basics Iceberg is an open table format designed for large analytic workloads.

Data Warehouse 82

Data Warehouse Snapshot Metadata Cost-Benefit 82

AWS Big Data

JUNE 21, 2023

In traditional databases, we would model such applications using a normalized data model (entity-relation diagram). A key pillar of AWS’s modern data strategy is the use of purpose-built data stores for specific use cases to achieve performance, cost, and scale. These types of queries are suited for a data warehouse.

Data Warehouse 80

Data Warehouse Data Lake OLAP Cost-Benefit 80

Cloudera

AUGUST 8, 2022

In June 2022, Cloudera announced the general availability of Apache Iceberg in the Cloudera Data Platform (CDP). The general availability covers Iceberg running within some of the key data services in CDP, including Cloudera Data Warehouse ( CDW ), Cloudera Data Engineering ( CDE ), and Cloudera Machine Learning ( CML ).

Snapshot 94

Snapshot Data Warehouse Machine Learning Cost-Benefit 94

AWS Big Data

APRIL 3, 2024

Snowflake integrates with AWS Glue Data Catalog to access the Iceberg table catalog and the files on Amazon S3 for analytical queries. This greatly improves performance and compute cost in comparison to external tables on Snowflake , because the additional metadata improves pruning in query plans.

Data Lake 94

Data Lake Snapshot Metadata Data Architecture 94

CIO Business Intelligence

MAY 16, 2022

From the factory floor to online commerce sites and containers shuttling goods across the global supply chain, the proliferation of data collected at the edge is creating opportunities for real-time insights that elevate decision-making. The concept of the edge is not new, but its role in driving data-first business is just now emerging.

IoT 77

IoT Data Warehouse Internet of Things Machine Learning 77

AWS Big Data

MARCH 2, 2023

In early 2022, AWS announced general availability of Athena ACID transactions, powered by Apache Iceberg. There is an increased need for data lakes to support database like features such as ACID transactions, record-level updates and deletes, time travel, and rollback. The snapshot points to the manifest list.

Data Lake 118

Data Lake Data Processing Metadata Snapshot 118

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale.

Data Lake 113

Data Lake Metadata Optimization Statistics 113