article thumbnail

5 things on our data and AI radar for 2021

O'Reilly on Data

Here are some of the most significant themes we see as we look toward 2021. The Right Solution for Your Data: Cloud Data Lakes and Data Lakehouses. Data lakes have experienced a fairly robust resurgence over the last few years, specifically cloud data lakes.

Data Lake 286
article thumbnail

Simplify operational data processing in data lakes using AWS Glue and Apache Hudi

AWS Big Data

A modern data architecture is an evolutionary architecture pattern designed to integrate a data lake, data warehouse, and purpose-built stores with a unified governance model. The company wanted the ability to continue processing operational data in the secondary Region in the rare event of primary Region failure.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

How Ruparupa gained updated insights with an Amazon S3 data lake, AWS Glue, Apache Hudi, and Amazon QuickSight

AWS Big Data

In this post, we show how Ruparupa implemented an incrementally updated data lake to get insights into their business using Amazon Simple Storage Service (Amazon S3), AWS Glue , Apache Hudi , and Amazon QuickSight. An AWS Glue ETL job, using the Apache Hudi connector, updates the S3 data lake hourly with incremental data.

article thumbnail

Data Modeling 301 for the cloud: data lake and NoSQL data modeling and design

erwin

For NoSQL, data lakes, and data lake houses—data modeling of both structured and unstructured data is somewhat novel and thorny. This blog is an introduction to some advanced NoSQL and data lake database design techniques (while avoiding common pitfalls) is noteworthy. Data Modeling.

article thumbnail

Celebrating Data Superheroes: The 2021 Data Impact Awards Winners

Cloudera

Given the way we have seen communities and workplace cultures come together and stand for change over what has been a disruptive 20 months, we are proud to introduce the People First category to the 2021 DIA. So, without further ado, it is with great delight that we officially publish the 2021 Data Impact Award winners!

article thumbnail

Thermo Fisher transforms its customer experience

CIO Business Intelligence

The rapid growth left the company highly dependent on fragmented, manual processes and disparate data sources and systems. For its order-entry automation module, Northstar leans on AI and RPA to optimize data recognition and verification, and to reduce errors and accelerate order cycle times. Catalyzing change.

IT 104
article thumbnail

The Future of the Data Lakehouse – Open

Cloudera

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes. Iterations of the lakehouse.