article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

New in 2021. Figure 2 – CDE product launch highlights in 2021. Early on in 2021 we expanded our APIs to support pipelines using a new job type — Airflow. This enabled new use-cases with customers that were using a mix of Spark and Hive to perform data transformations. . Modernizing pipelines. Happy New Year.

Snapshot 119
article thumbnail

Sisense Q1 2021 Release: Infuse Customized Intelligence at Scale

Sisense

In Gartner’s Top 10 Data and Analytics Trends for 2021, trend No. The Sisense Q1 2021 release is focused on bringing customized analytics to each person. Advanced data transformation with Custom Code. Prepare for the power of personalized analytics in 2021! Rapid, code-free customization with Sisense Themes.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Gain insights from historical location data using Amazon Location Service and AWS analytics services

AWS Big Data

You can also use the data transformation feature of Data Firehose to invoke a Lambda function to perform data transformation in batches. The firehose table stores raw, unmodified data from the Amazon Location tracker. This method uses GZIP compression to optimize storage consumption and query performance.

article thumbnail

Straumann Group is transforming dentistry with data, AI

CIO Business Intelligence

But to augment its various businesses with ML and AI, Iyengar’s team first had to break down data silos within the organization and transform the company’s data operations. Digitizing was our first stake at the table in our data journey,” he says.

article thumbnail

How to Implement Data Lineage Mapping Techniques

Octopai

In other words, kind of like Hansel and Gretel in the forest, your data leaves a trail of breadcrumbs – the metadata – to record where it came from and who it really is. So the first step in any data lineage mapping project is to ensure that all of your data transformation processes do in fact accurately record metadata.

Metadata 130
article thumbnail

Intro to R and Power BI Presentation and a Presenting Secret

Jen Stirrup

I was all set to present this session at the European Collaboration Summit in November 2021, but the organizers needed to change the time and date of my session which was rescheduled to take place after I’d left to go back home. Then, we will move towards powerful but simple to use datatypes in R such as data frames.

article thumbnail

Create a modern data platform using the Data Build Tool (dbt) in the AWS Cloud

AWS Big Data

In this post, we delve into a case study for a retail use case, exploring how the Data Build Tool (dbt) was used effectively within an AWS environment to build a high-performing, efficient, and modern data platform. It does this by helping teams handle the T in ETL (extract, transform, and load) processes.