Cloudera

APRIL 30, 2021

Apache Spark is now widely used in many enterprises for building high-performance ETL and Machine Learning pipelines. If the users are already familiar with Python then PySpark provides a python API for using Apache Spark. Apache Spark provides several options to manage these dependencies.

Management 62

Management Data Processing Machine Learning Enterprise 62

Cloudera

JUNE 26, 2023

Here are some tips and tricks of the trade to prevent well-intended yet inappropriate data engineering and data science activities from cluttering or crashing the cluster. Take precaution using CDSW as an all-purpose workflow management and scheduling tool. So which open source pipeline tool is better, NiFi or Airflow?

Testing 76

Testing Data Processing Visualization Data Science 76

Cloudera

JULY 13, 2021

After the launch of CDP Data Engineering (CDE) on AWS a few months ago, we are thrilled to announce that CDE, the only cloud-native service purpose built for enterprise data engineers, is now available on Microsoft Azure. . Resource isolation and centralized GUI-based job management. Easy job deployment.

Enterprise 126

Enterprise Visualization Testing Management 126

Cloudera

OCTOBER 4, 2023

Fast moving data and real time analysis present us with some amazing opportunities. Every organization has some data that happens in real time, whether it is understanding what our users are doing on our websites or watching our systems and equipment as they perform mission critical tasks for us. Don’t blink — or you’ll miss it!

Data Warehouse 86

Data Warehouse Experimentation Cost-Benefit Dashboards 86

Cloudera

AUGUST 17, 2021

When we announced the GA of Cloudera Data Engineering back in September of last year, a key vision we had was to simplify the automation of data transformation pipelines at scale. And by being purely python based, Apache Airflow pipelines are accessible to a wide range of users, with a strong open source community.

Management 111

Management Cost-Benefit Data Transformation Optimization 111

Cloudera

MARCH 23, 2022

Please join us on March 24 for Future of Data meetup where we do a deep dive into Iceberg with CDP . Apache Iceberg is a high-performance, open table format, born-in-the cloud that scales to petabytes independent of the underlying storage layer and the access engine layer. What is Apache Iceberg? 1: Multi-function analytics .

Metadata 90

Metadata Data Architecture Machine Learning Cost-Benefit 90

Cloudera

SEPTEMBER 17, 2020

For enterprise organizations, managing and operationalizing increasingly complex data across the business has presented a significant challenge for staying competitive in analytic and data science driven markets. Resource isolation and centralized GUI-based job management.

Visualization 102

Visualization Metrics Statistics Optimization 102