AWS Big Data

APRIL 3, 2024

Businesses are constantly evolving, and data leaders are challenged every day to meet new requirements. For many enterprises and large organizations, it is not feasible to have one processing engine or tool to deal with the various business requirements. This post is co-written with Andries Engelbrecht and Scott Teal from Snowflake.

Data Lake 94

Data Lake Snapshot Metadata Data Architecture 94

AWS Big Data

OCTOBER 3, 2023

A data lake is a centralized repository that you can use to store all your structured and unstructured data at any scale. You can store your data as-is, without having to first structure the data and then run different types of analytics for better business insights.

Data Lake 102

Data Lake Metadata Snapshot Recreation/Entertainment 102

Cloudera

MARCH 5, 2024

But even with its rise, AI is still a struggle for some enterprises. AI, and any analytics for that matter, are only as good as the data upon which they are based. Cloudera is now the only provider to offer an open data lakehouse with Apache Iceberg for cloud and on-premises. And that’s where the rub is.

Snapshot 89

Snapshot Data Lake Enterprise Data Governance 89

AWS Big Data

NOVEMBER 10, 2023

The data sourcing problem To ensure the reliability of PySpark data pipelines, it’s essential to have consistent record-level data from both dimensional and fact tables stored in the Enterprise Data Warehouse (EDW). These tables are then joined with tables from the Enterprise Data Lake (EDL) at runtime.

Data Processing 93

Data Processing Data Lake Data Warehouse Optimization 93

AWS Big Data

MARCH 20, 2023

In the first post of this series , we described how AWS Glue for Apache Spark works with Apache Hudi, Linux Foundation Delta Lake, and Apache Iceberg datasets tables using the native support of those data lake formats. Even without prior experience using Hudi, Delta Lake or Iceberg, you can easily achieve typical use cases.

Visualization 80

Visualization Data Lake Snapshot Big Data 80

Cloudera

MARCH 23, 2022

By being a truly open table format, Apache Iceberg fits well within the vision of the Cloudera Data Platform (CDP). Let’s highlight some of those benefits, and why choosing CDP and Iceberg can future proof your next generation data architecture. . 4: Enterprise grade. 1: Multi-function analytics . Financial regulation.

Metadata 94

Metadata Data Architecture Machine Learning Cost-Benefit 94

AWS Big Data

MARCH 3, 2023

Tricentis is the global leader in continuous testing for DevOps, cloud, and enterprise applications. Finally, data integrity is of paramount importance. Every event in the data source can be relevant, and our customers don’t tolerate data loss, poor data quality, or discrepancies between the source and Tricentis Analytics.

Software 52

Software Data Lake Testing Cost-Benefit 52