Jen Stirrup

NOVEMBER 30, 2021

I was all set to present this session at the European Collaboration Summit in November 2021, but the organizers needed to change the time and date of my session which was rescheduled to take place after I’d left to go back home. Then, we will move towards powerful but simple to use datatypes in R such as data frames.

Dashboards 90

Dashboards Visualization Data Transformation Publishing 90

AWS Big Data

MARCH 13, 2024

You can also use the data transformation feature of Data Firehose to invoke a Lambda function to perform data transformation in batches. Visual layouts in some screenshots in this post may look different than those on your AWS Management Console.

Analytics 91

Analytics IoT Metadata Internet of Things 91

Octopai

MARCH 31, 2021

In other words, kind of like Hansel and Gretel in the forest, your data leaves a trail of breadcrumbs – the metadata – to record where it came from and who it really is. So the first step in any data lineage mapping project is to ensure that all of your data transformation processes do in fact accurately record metadata.

Metadata 130

Metadata Data Transformation Business Intelligence Reporting 130

Cloudera

DECEMBER 9, 2022

In 2021 we launched Cloudera DataFlow for the Public Cloud (CDF-PC) , addressing operational challenges that administrators face when running NiFi flows in production environments. Developers need to onboard new data sources, chain multiple data transformation steps together, and explore data as it travels through the flow.

Testing 95

Testing Cost-Benefit Interactive Visualization 95

AWS Big Data

APRIL 25, 2024

Alternatively, you can use AWS Glue for Apache Spark, which provides built-in support for bucketing configurations during the data transformation process. AWS Glue allows you to define bucketing parameters, such as the number of buckets and the columns to bucket on, providing an optimized data layout for efficient querying with Athena.

Optimization 65

Optimization Data Lake Cost-Benefit Reporting 65

DataKitchen

OCTOBER 5, 2021

Too many data organizations run data operations like a hundred-year-old car factory. While car companies lowered costs using mass production, companies in 2021 put data engineers and data scientists on the assembly line. That’s the state of data analytics today. . Their product is the data.

Testing 157

Testing Dashboards Measurement Experimentation 157

Octopai

JANUARY 19, 2021

Octopai is the first BI Intelligence Platform in the Industry to Support Azure Data Factory, Providing Full Lineage of Advanced BI Tools. With Octopai’s support and analysis of Azure Data Factory, enterprises can now view complete end-to-end data lineage from Azure Data Factory all the way through to reporting for the first time ever.

Metadata 52

Metadata ROI Optimization Data Quality 52