Cloudera

JUNE 2, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. Every organization on the hybrid cloud journey needs the ability to take control of their data flows from origination through all points of consumption.

Enterprise 107

Enterprise Data Lake Data Collection Data-driven 107

Cloudera

JUNE 5, 2023

The flow he built differentiates between test or true API call before initiating a secure log in. Completeness is estimated by comparing a test result with “estimated total.” RK built some simple flows to pull streaming data into Google Cloud Storage and Snowflake. The brilliant part comes next.

Testing 79

Testing Data Lake Data Processing IT 79

AWS Big Data

JUNE 6, 2023

Unless, of course, the rest of their data also resides in the Google Cloud. In this post we showcase how we used AWS Glue to move siloed digital analytics data, with inconsistent arrival times, to AWS S3 (our Data Lake) and our central data warehouse (DWH), Snowflake. It consists of full-day and intraday tables.

Analytics 55

Analytics Data Lake Testing Optimization 55

CIO Business Intelligence

JULY 13, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. Every organization on the hybrid cloud journey needs the ability to take control of their data flows from origination through all points of consumption.

Enterprise 63

Enterprise Data Lake Data Collection Data-driven 63

AWS Big Data

FEBRUARY 1, 2023

With data volumes exhibiting a double-digit percentage growth rate year on year and the COVID pandemic disrupting global logistics in 2021, it became more critical to scale and generate near-real-time data. You can visually create, run, and monitor extract, transform, and load (ETL) pipelines to load data into your data lakes.

Optimization 52

Optimization Forecasting Data Lake Metadata 52

AWS Big Data

NOVEMBER 17, 2023

Athena provides a simplified, flexible way to analyze petabytes of data where it lives. You can analyze data or build applications from an Amazon Simple Storage Service (Amazon S3) data lake and 30 data sources, including on-premises data sources or other cloud systems using SQL or Python.

Optimization 112

Optimization Statistics Metadata Data Lake 112

AWS Big Data

OCTOBER 23, 2023

Modern applications store massive amounts of data on Amazon Simple Storage Service (Amazon S3) data lakes, providing cost-effective and highly durable storage, and allowing you to run analytics and machine learning (ML) from your data lake to generate insights on your data.

Data Lake 102

Data Lake Visualization Optimization Interactive 102