Cloudera

AUGUST 8, 2022

In June 2022, Cloudera announced the general availability of Apache Iceberg in the Cloudera Data Platform (CDP). The general availability covers Iceberg running within some of the key data services in CDP, including Cloudera Data Warehouse ( CDW ), Cloudera Data Engineering ( CDE ), and Cloudera Machine Learning ( CML ).

Snapshot 92

Snapshot Data Warehouse Machine Learning Cost-Benefit 92

Cloudera

NOVEMBER 12, 2021

My ten year old began to demonstrate how to deploy an Operational Database in AWS, showcasing how auto-scaling worked and how to set up replication. During the development of Operational Database and Replication Manager, I kept telling folks across the team it has to be “so simple that a 10 year old can demo it”.

Software 97

Software Enterprise Snapshot IT 97

Cloudera

DECEMBER 8, 2021

CDP Operational Database (COD) is a real-time auto-scaling operational database powered by Apache HBase and Apache Phoenix. It is one of the main Data Services that runs on Cloudera Data Platform (CDP) Public Cloud. You can access COD right from your CDP console.

Testing 92

Testing Optimization Data Processing Management 92

Cloudera

DECEMBER 1, 2020

In this blog post, let us take a look at how you can plan your infrastructure planning that you may have to do when deploying an operational database cluster on a CDP Private Cloud Base deployment. You can learn more about Cloudera Operational Database in CDP here: Operational Database in CDP. .

OLAP 59

OLAP Metadata Finance Technology 59

Cloudera

JANUARY 6, 2021

Python is used extensively among Data Engineers and Data Scientists to solve all sorts of problems from ETL/ELT pipelines to building machine learning models. For data professionals that want to make use of data stored in HBase the recent upstream project “hbase-connectors” can be used with PySpark for basic operations.

Machine Learning 133

Machine Learning Data Science Management Enterprise 133

Cloudera

MAY 17, 2021

CDP (Cloudera Data Platform) Private Cloud 1.2 was recently released and builds on the success of CDP Private Cloud Base (see the 7.1.6 To deliver its cloud-native capabilities, CDP Private Cloud leverages Red Hat’s OpenShift. release blog ). Platform – In-place Updates. Platform – In-place Updates.

Machine Learning 89

Machine Learning Data Warehouse Data-driven Metrics 89

Cloudera

JUNE 22, 2023

In spite of diligent digital transformation efforts, most financial services institutions still support a loose patchwork of siloed systems and repositories. The combination of these features improves the accuracy of financial reporting, operational analytics, and other data-driven initiatives. Simplified compliance.

Cost-Benefit 67

Cost-Benefit Digital Transformation Data Governance Unstructured Data 67

Cloudera

NOVEMBER 30, 2022

What is CDP Operational Database (COD). CDP Operational Database enables developers to quickly build future-proof applications that are architected to handle data evolution. For more information and to get started with COD, refer to Getting Started with Cloudera Data Platform Operational Database (COD).

Snapshot 83

Snapshot Big Data Management Testing 83

Cloudera

SEPTEMBER 9, 2021

The CDP Operational Database ( COD ) builds on the foundation of existing operational database capabilities that were available with Apache HBase and/or Apache Phoenix in legacy CDH and HDP deployments. Technology Cost Optimization. There are two major drivers of technology cost optimization with COD: .

Cost-Benefit 95

Cost-Benefit Optimization Risk Management 95

Cloudera

SEPTEMBER 29, 2020

Performance is one of the key, if not the most important deciding criterion, in choosing a Cloud Data Warehouse service. In today’s fast changing world, enterprises have to make data driven decisions quickly and for that they rely heavily on their data warehouse service. . CDW is an analytic offering for Cloudera Data Platform (CDP).

Data Warehouse 118

Data Warehouse Metadata Data-driven Machine Learning 118

Cloudera

NOVEMBER 10, 2021

Cloudera Data Platform (CDP) brings many improvements to customers by merging technologies from the two legacy platforms, Cloudera Enterprise Data Hub (CDH) and Hortonworks Data Platform (HDP). So, upgrading to a new major version in CDP can create hesitation and apprehension. Why switch to Ranger?

Data Lake 77

Data Lake Management Metadata Modeling 77

Cloudera

JUNE 28, 2022

We discussed how Cloudera Stream Processing (CSP) with Apache Kafka and Apache Flink could be used to process this data in real time and at scale. In this blog we will show a real example of how that is done, looking at how we can use CSP to perform real-time fraud detection. The use case.

Dashboards 84

Dashboards Machine Learning Statistics KPI 84

Cloudera

SEPTEMBER 30, 2021

Our recent blog discussed the four paths to get from legacy platforms to CDP Private Cloud Base. In this blog and accompanying video, we will deep dive into the mechanics of running an in-place upgrade from CDH5 or CDH6 to CDP Private Cloud Base. CDP Upgrade.mp4 . CDP Upgrade.mp4 . Cloudera Manager data.

Metadata 71

Metadata Testing Management Data-driven 71

Cloudera

AUGUST 10, 2021

With the release of CDP Private Cloud (PvC) Base 7.1.7, We understand that migrating your data platform to the latest version can be an intricate task, and at Cloudera we’ve worked hard to simplify this process for all our customers. . x customers to upgrade in-place to CDP PvC Base without having to create a new cluster.

Metadata 97

Metadata Sales Statistics Management 97

Cloudera

OCTOBER 19, 2021

Airflow has been adopted by many Cloudera Data Platform (CDP) customers in the public cloud as the next generation orchestration service to setup and operationalize complex data pipelines. Long-tail of operators. Although Airflow offers 100s of operators, users tend to use only a subset of them.

Data Transformation 118

Data Transformation Interactive Machine Learning Testing 118

Cloudera

SEPTEMBER 30, 2022

Cloudera DataFlow for the Public Cloud (CDF-PC) is a cloud-native service for Apache NiFi within the Cloudera Data Platform (CDP). New use cases: event-driven, batch, and microservices. However, customers also have a class of use cases that do not require always running NiFi flows.

IoT 75

IoT Data-driven Modeling Optimization 75

Cloudera

NOVEMBER 15, 2022

CDP Operational Database (COD) is a real-time auto-scaling operational database powered by Apache HBase and Apache Phoenix. It is one of the main data services that run on Cloudera Data Platform (CDP) Public Cloud. You can access COD from your CDP console. HBase on S3 review.

Snapshot 78

Snapshot Cost-Benefit Reporting IT 78

Cloudera

JULY 14, 2023

But as the data volumes, data variety, and data usage grows, users face many challenges when using Hive tables because of its antiquated directory-based table format. In this blog, I will describe a few strategies one could undertake for various use cases. In all the use cases we are trying to migrate a table named “events.”

Snapshot 72

Snapshot Metadata Data Warehouse Testing 72

Cloudera

JUNE 25, 2021

Many Cloudera customers are making the transition from being completely on-prem to cloud by either backing up their data in the cloud, or running multi-functional analytics on CDP Public cloud in AWS or Azure. The Replication Manager service facilitates both disaster recovery and data migration across different environments.

Data Lake 70

Data Lake Metadata Unstructured Data Management 70

Cloudera

FEBRUARY 26, 2021

Cloudera Operational Database is an operational database-as-a-service that brings ease of use and flexibility to Apache HBase. Cloudera Operational Database enables developers to quickly build future-proof applications that are architected to handle data evolution.

Interactive 59

Interactive IT 59

Cloudera

DECEMBER 21, 2020

In this blog we will take you through a persona-based data adventure, with short demos attached, to show you the A-Z data worker workflow expedited and made easier through self-service, seamless integration, and cloud-native technologies. The company has previously created a business unit tenant in CDP Public Cloud. The Data Scientist.

Dashboards 98

Dashboards Visualization Data Warehouse Data Lake 98

CIO Business Intelligence

JUNE 30, 2023

It’s well acknowledged that data, when used correctly, has the potential to be a strategic growth asset driving innovation – and with the recent developments in large language models (LLM) for AI, data is really having its day in the sun. In the long run, the goal is to use data proactively to generate growth.

Internet of Things 103

Internet of Things Strategy Data Strategy Risk 103

Cloudera

DECEMBER 10, 2020

Instead, you face runaway operational costs. What is Cloudera Data Warehouse (CDW)? Many tasks that often require expensive technical help are now self-service because it leverages the elastic cloud-native capabilities of CDP. 150 for storage use = $15 / TB / month x 10 TB.

Data Warehouse 98

Data Warehouse Metadata Cost-Benefit Optimization 98

Cloudera

SEPTEMBER 23, 2020

In this blogpost, we are going to take a look at some of the OpDB related security features of a CDP Private Cloud Base deployment. Comprehensive auditing is provided to enable enterprises to effectively and efficiently meet their compliance requirements by auditing access and other types of operations across OpDB (through HBase).

Data Lake 81

Data Lake Metadata IoT Enterprise 81

Cloudera

APRIL 26, 2021

CDP is using Apache Ranger for data security management. This can be done via the Ranger webUI, accessible from Cloudera Manager. HBase access levels are granted independently of each other and allow for different types of operations at a given scope. Login via Kerberos with the HBase service credentials.

Finance 96

Finance Testing Metadata Management 96

Cloudera

FEBRUARY 11, 2021

When Kudu was first introduced as a part of CDH in 2017, it didn’t support any kind of authorization so only air-gapped and non-secure use cases were satisfied. which made it possible to restrict access only to Apache Impala where Apache Sentry policies could be applied, enabling a lot more use cases. How it works.

Metadata 52

Metadata Management IT Analytics 52

Cloudera

SEPTEMBER 11, 2020

In this blog post, we are going to take a look at some of the OpDB related security features of a CDP Private Cloud Base deployment. OpDB uses Transport Layer Security (TLS) security protocol for wire encryption. Ranger Key Management Service. The EZKs are stored in a secure database within the KMS. Decryption.

Management 66

Management Big Data Testing Data Integration 66

Cloudera

APRIL 9, 2021

This blog series follows the manufacturing and operations data lifecycle stages of an electric car manufacturer – typically experienced in large, data-driven manufacturing companies. Serving Data – operational database. The second blog dealt with creating and managing Data Enrichment pipelines. Here are the key stages: .

Machine Learning 98

Machine Learning Forecasting Manufacturing Predictive Analytics 98

Cloudera

APRIL 23, 2021

In other words, data remains encrypted until it reaches the HDFS client. Each HDFS file is encrypted using an encryption key. To add another layer of security, the file encryption key is stored in encrypted form, using another “encryption zone key” Configuring this feature is relatively straightforward.

Data Processing 69

Data Processing Metadata Testing Management 69

Cloudera

NOVEMBER 12, 2020

Here at Cloudera, we’ve seen many large organizations struggle to meet ever-changing and ever-growing business demands. What we need is an easy way to get to the cloud, and use it only when we need it, and not run up the bill when we don’t. . This causes resource restrictions on various groups that use the platform.

Data Warehouse 103

Data Warehouse Reporting Risk Cost-Benefit 103

Cloudera

JULY 13, 2022

In this article we discuss the various methods to replicate HBase data and explore why Replication Manager is the best choice for the job with the help of a use case. Cloudera Replication Manager is a key Cloudera Data Platform (CDP) service, designed to copy and migrate data between environments and infrastructures across hybrid clouds.

Snapshot 90

Snapshot Management Cost-Benefit Metadata 90

Cloudera

DECEMBER 2, 2021

For Cloudera ensuring data security is critical because we have large customers in highly regulated industries like financial services and healthcare, where security is paramount. At Cloudera we want to help all customers to spend more time analyzing data than protecting data.

Data Lake 125

Data Lake Data Warehouse Data Processing Interactive 125

Cloudera

DECEMBER 15, 2022

Since we announced the general availability of Apache Iceberg in Cloudera Data Platform (CDP), Cloudera customers, such as Teranet , have built open lakehouses to future-proof their data platforms for all their analytical workloads. Cloudera partners are also benefiting from Apache Iceberg in CDP.

Metadata 79

Metadata Data Warehouse Snapshot Data Quality 79

Cloudera

FEBRUARY 22, 2022

The data explosion has to be met with new solutions, that’s why we are excited to introduce the next generation table format for large scale analytic datasets within Cloudera Data Platform (CDP) – Apache Iceberg. Apache Iceberg is a new open table format targeted for petabyte-scale analytic datasets.

Snapshot 108

Snapshot Metadata Cost-Benefit Data Architecture 108

Cloudera

SEPTEMBER 1, 2022

Apache HBase has long been the database of choice for business-critical applications across industries. This is primarily because HBase provides unmatched scale, performance, and fault-tolerance that few other databases can come close to. It’s a cloud-native data service that is available on AWS, Azure, and GCP.

Snapshot 83

Snapshot Enterprise Machine Learning Management 83

Cloudera

OCTOBER 5, 2021

Cloudera Data Platform (CDP) supports access controls on tables and columns, as well as on files and directories via Apache Ranger since its first release. Unfortunately, in such instances you would have to create and maintain separate Ranger policies for both Hive and HDFS, that correspond to each other. . How does it help?

Management 95

Management Metadata IT Interactive 95

Cloudera

AUGUST 20, 2021

How CDP Enables and Accelerates Data Product Ecosystems. The Cloudera Data Platform comprises a number of ‘data experiences’ each delivering a distinct analytical capability using one or more purposely-built Apache open source projects such as Apache Spark for Data Engineering and Apache HBase for Operational Database workloads.

Strategy 97

Strategy Cost-Benefit Visualization Data Warehouse 97