Cloudera

NOVEMBER 1, 2023

Elevate your AI applications with our latest applied ML prototype At Cloudera, we continuously strive to empower organizations to unlock the full potential of their data, catalyzing innovation and driving actionable insights. High-level overview of real-time data ingest with Cloudera DataFlow to Pinecone vector database.

Machine Learning 105

Machine Learning Optimization Modeling Interactive 105

Ontotext

MARCH 13, 2024

We started with our marketing content and quickly expanded that to also integrate a set of workflows for data and content management. To make this as valuable as possible, the system needs to work with the latest content, so we have built workflows to maintain the data in the graph in sync with what is published on our website.

Marketing 72

Marketing Knowledge Discovery Metadata Data-driven 72

Cloudera

FEBRUARY 16, 2021

In the previous blog post , we looked at some of the application development concepts for the Cloudera Operational Database (COD). In this blog post, we’ll see how you can use other CDP services with COD. Integrated across the Enterprise Data Lifecycle . Cloudera Data Engineering to ingest bulk data and data from mainframes.

Machine Learning 81

Machine Learning Data Lake Enterprise Data Warehouse 81

AWS Big Data

JULY 28, 2023

You can use Athena to run SQL queries on petabytes of data stored on Amazon Simple Storage Service (Amazon S3) in widely used formats such as Parquet and open-table formats like Apache Iceberg, Apache Hudi, and Delta Lake. In Athena, we refer to queries on non-Amazon S3 data sources as federated queries. Let’s dive into the solution.

Big Data 77

Big Data Data Architecture Data Lake Interactive 77

AWS Big Data

JUNE 2, 2023

Amazon Redshift is a widely used, fully managed, petabyte-scale cloud data warehouse. Tens of thousands of customers use Amazon Redshift to process exabytes of data every day to power their analytic workloads. This pre-built solution scales to load data in parallel using input parameters.

Metadata 109

Metadata Data Warehouse Big Data Testing 109

IBM Big Data Hub

APRIL 2, 2024

In order to stay ahead, businesses need to enable proactive decision making—and this stems from building an IT infrastructure that provides the foundation for the availability of real-time data. A core part of the solution needed comes from messaging infrastructure and many businesses already have a strong foundation in place.

Data-driven 64

Data-driven Interactive Technology Data Collection 64

Cloudera

JUNE 7, 2021

Since then, we have been working hard to expose the full power of Apache Flink SQL and the existing Data Warehousing tools in CDP to combine it into a state-of-the-art real-time analytics platform. Custom connector support. This step significantly speeds up query development and data exploration. Improved Table Management.

Analytics 101

Analytics Management IT 101

AWS Big Data

MAY 18, 2023

Deriving insight from data is hard. It’s even harder when your organization is dealing with silos that impede data access across different data stores. Seamless data integration is a key requirement in a modern data architecture to break down data silos. AWS Glue released version 4.0 runtime ( 3.5

Testing 75

Testing Data Lake Cost-Benefit Data Integration 75

AWS Big Data

FEBRUARY 9, 2023

Customers across industries seek meaningful insights from the data captured in their Customer Relationship Management (CRM) systems. To achieve this, they combine their CRM data with a wealth of information already available in their data warehouse, enterprise systems, or other software as a service (SaaS) applications.

Data Warehouse 74

Data Warehouse Data-driven Snapshot Testing 74

Cloudera

NOVEMBER 18, 2022

Stream processing is about creating business value by applying logic to your data while it is in motion. Many times that involves combining data sources to enrich a data stream. Flink SQL does this and directs the results of whatever functions you apply to the data into a sink. Using Flink DDL with JDBC connector.

Data Processing 57

Data Processing Advertising IT 57

Cloudera

FEBRUARY 9, 2021

Cloudera Operational Database is now available in three different form-factors in Cloudera Data Platform (CDP). . If you are new to Cloudera Operational Database, see this blog post. In this blog post, we’ll look at both Apache HBase and Apache Phoenix concepts relevant to developing applications for Cloudera Operational Database.

Interactive 101

Interactive Machine Learning Data Science IT 101

Alation

FEBRUARY 18, 2021

Alation has evolved a great deal since pioneering the data catalog category. Initially, Alation was a solution that made it dramatically easier to find, understand, and trust data. Now, Alation is a platform for a broad range of data intelligence use cases — from data search & discovery to data governance to cloud migration.

Metadata 52

Metadata Dashboards Data Governance Marketing 52

Paul Blogs on BI

JUNE 1, 2022

Whoever created the phrase, “best thing since sliced bread”, it has prevailed in our English vocabulary since the 1930’s as an expression that refers to something that someone thinks is very good, original, and exciting, which is exactly why I want to blog about InfoBurst Squirrel. The cache can contain millions of rows of data.

ROI 52

ROI Dashboards Visualization Interactive 52

Cloudera

JUNE 2, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. This need has generated a market opportunity for a universal data distribution service. Why does every organization need it when using a modern data stack?

Enterprise 99

Enterprise Data Lake Data Collection Data-driven 99

Cloudera

JUNE 10, 2021

Apache Spark is a very popular analytics engine used for large-scale data processing. It is widely used for many big data applications and use cases. In this blog post, let us look at how you can read and write data to COD from Apache Spark. For more information, see Configure Phoenix-Spark connector | CDP Public Cloud.

Testing 88

Testing Big Data Interactive Data Processing 88

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

IBM Big Data Hub

OCTOBER 18, 2023

On December 5–6, 2023 at the Computer History Museum in Mountain View, CA, hundreds of developers and software engineers will come together at PrestoCon 2023 to support and learn more about Presto, the open-source SQL query engine for data analytics and the Open Data Lakehouse.

Statistics 92

Statistics Software Data Analytics Analytics 92

AWS Big Data

APRIL 20, 2023

Customers use Amazon Redshift to run their business-critical analytics on petabytes of structured and semi-structured data. Apache Spark enables you to build applications in a variety of languages, such as Java, Scala, and Python, by accessing the data in your Amazon Redshift data warehouse.

Data Lake 74

Data Lake Data Warehouse Sales Data-driven 74

IBM Big Data Hub

JANUARY 8, 2024

 It includes a built-in schema registry to validate event data from applications as expected, improving data quality and reducing errors. For disaster recovery, the geo-replication feature can create copies of event data to send to a backup cluster, with the user interface making this configurable in a few clicks.

Data-driven 80

Data-driven Management Advertising Enterprise 80

Ontotext

OCTOBER 28, 2021

This means that inferred statements are changed – inserted or removed – during data updates. No data is ingested for these repositories. Even if data was inferred for virtualized repositories, it would probably contain literals. Literals, like the value of the object, are not stored in the same data structure.

Data Quality 98

Data Quality IT 98

Alation

MARCH 2, 2023

Instead, we got data. Lots and lots of data. It does feel, however, as if we need jet-like speed to analyze and understand our data, who is using it, how it is used, and if it is being used to drive value. This is because simply collecting data leaves it open to misinterpretation, misuse, and decay.

Metadata 52

Metadata Marketing IT Data Quality 52

erwin

MAY 1, 2023

The World Wide Data Vault Consortium ( WWDVC 2023 ) started today and erwin ® by Quest ® , one of the few active participants working toward a Data Vault 2.0 certification with the DataVaultAlliance , is announcing major advancements in our erwin Data Vault Automation solution.

Cost-Benefit 52

Cost-Benefit Data Governance Metadata Data-driven 52

Smarten

NOVEMBER 3, 2023

Knowledgebase Articles SSDP : Adding a new JDBC/ODBC Database Driver/Connector to Smarten Smarten Application Security : Brute force vulnerabilities and solutions Predictive Use cases Handling Outliers Using Smarten Assisted Predictive Modelling Handling Missing Values using Smarten Augmented Analytics Forum Topics Teamup: How to Configure TeamUp?

Predictive Modeling 52

Predictive Modeling Modeling Analytics Business Intelligence 52

AWS Big Data

JUNE 6, 2023

This is a guest blog post by Mira Daniels and Sean Whitfield from SumUp. Unless, of course, the rest of their data also resides in the Google Cloud. AWS Glue gave us a cost-efficient option to migrate the data and we further optimized storage cost by pruning cold data.

Analytics 56

Analytics Data Lake Testing Optimization 56

CIO Business Intelligence

JUNE 28, 2023

The fully managed AppFabric offering, which has been made generally available, is designed to help enterprises maintain SaaS application interoperability without having to develop connectors or workflows in-house while offering added security features, said Federico Torreti, the head of product for AppFabric.

Enterprise 130

Enterprise Modeling Metrics Machine Learning 130

Ontotext

JUNE 15, 2023

A graph database is a type of database that stores data as nodes and relationships instead of tables. Graph databases excel in handling complex and interconnected data and have become the go to solution for many enterprise challenges. Nodes represent entities, while edges represent the relationships between these entities.

Machine Learning 52

Machine Learning Data Integration Big Data Testing 52

BI-Survey

JUNE 7, 2020

The ecosystem around Microsoft Power BI is growing fast – consultancies and software vendors are adopting the platform to offer added value in visuals, apps, connectors and data management tools. Depending on the data you provide, you will be visible in one, two or all three browser objects. What happens with my data?

Consulting 85

Consulting Visualization Marketing Dashboards 85

Cloudera

OCTOBER 15, 2021

As organizations wrangle with the explosive growth in data volume they are presented with today, efficiency and scalability of storage become pivotal to operating a successful data platform for driving business insight and value. Moreover, Ozone seamlessly integrates with Apache data analytics tools like Hive, Spark and Impala.

Testing 86

Testing Measurement Optimization Metadata 86

Cloudera

JANUARY 6, 2021

Python is used extensively among Data Engineers and Data Scientists to solve all sorts of problems from ETL/ELT pipelines to building machine learning models. Apache HBase is an effective data storage system for many workflows but accessing this data specifically through Python can be a struggle. Example Operations .

Machine Learning 132

Machine Learning Data Science Management Enterprise 132

IBM Big Data Hub

OCTOBER 16, 2023

APIs serve as essential connectors between the growing number of data sources and applications in companies of all sizes and in all industries. This means that businesses are relying on and creating more APIs than ever before to get the data they need to power their applications and experiences, and scale their operations.

Management 75

Management Testing Machine Learning Software 75

Cloudera

MAY 1, 2023

Businesses everywhere have engaged in modernization projects with the goal of making their data and application infrastructure more nimble and dynamic. Placeholders can be used in the values fields of: Properties of table DDLs Properties of Kafka tables created with the wizard Kafka Data Source properties (e.g.

Testing 76

Testing Management Data Processing IT 76

CIO Business Intelligence

JULY 13, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. This need has generated a market opportunity for a universal data distribution service. Why does every organization need it when using a modern data stack?

Enterprise 62

Enterprise Data Lake Data Collection Data-driven 62

erwin

SEPTEMBER 26, 2019

The benefits of Data Vault automation from the more abstract – like improving data integrity – to the tangible – such as clearly identifiable savings in cost and time. So Seriously … You Should Automate Your Data Vault. By Danny Sandwell.

Data Warehouse 108

Data Warehouse Cost-Benefit Data Integration Modeling 108

DataKitchen

APRIL 28, 2021

Industry analysts who follow the data and analytics industry tell DataKitchen that they are receiving inquiries about “data fabrics” from enterprise clients on a near-daily basis. Gartner included data fabrics in their top ten trends for data and analytics in 2019. What is a Data Fabric?

Statistics 246

Statistics Optimization Technology Data Analytics 246

Cloudera

JUNE 5, 2023

On May 3, 2023, Cloudera kicked off a contest called “Best in Flow” for NiFi developers to compete to build the best data pipelines. This blog is to congratulate our winner and review the top submissions. The contest challenged developers to build data pipelines that represent their business use cases using Cloudera DataFlow.

Testing 74

Testing Data Lake Data Processing IT 74

AWS Big Data

JUNE 29, 2023

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud that delivers powerful and secure insights on all your data with the best price-performance. With Amazon Redshift, you can analyze your data to derive holistic insights about your business and your customers.

Data Warehouse 59

Data Warehouse Dashboards Testing Visualization 59

Cloudera

AUGUST 3, 2022

That’s why we are excited to introduce Spark Secure Access , a new security feature for Apache Spark in the Cloudera Data Platform (CDP), that adheres to all security policies without resorting to 3rd party tools. Within CDP, Shared Data Experience (SDX) provides centralized governance, security, cataloging, and lineage. df.show().

Snapshot 85

Snapshot Cost-Benefit Machine Learning Data Transformation 85