AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale.

Data Lake 114

Data Lake Metadata Optimization Statistics 114

AWS Big Data

FEBRUARY 12, 2024

Objective Gupshup wanted to build a messaging analytics platform that provided: Build a platform to get detailed insights, data, and reports about WhatsApp/SMS campaigns and track the success of every text message sent by the end customers. Additionally, extract, load, and transform (ELT) data processing is sped up and made easier.

Data Warehouse 101

Data Warehouse Analytics Snapshot Cost-Benefit 101

Cloudera

FEBRUARY 8, 2024

Apache Iceberg is a high-performance open table format for petabyte-scale analytic datasets. It brings the reliability and simplicity of SQL tables to big data while enabling engines like Hive, Impala, Spark, Trino, Flink, and Presto to work with the same tables at the same time.

Snapshot 94

Snapshot Metadata Cost-Benefit Data Warehouse 94

AWS Big Data

MAY 30, 2023

Customers have been using data warehousing solutions to perform their traditional analytics tasks. Traditional batch ingestion and processing pipelines that involve operations such as data cleaning and joining with reference data are straightforward to create and cost-efficient to maintain. mode("append").save(s3_output_folder)

Data Lake 82

Data Lake Data Analytics Analytics Data Processing 82

Cloudera

APRIL 3, 2023

Cloudera Contributors: Ayush Saxena, Tamas Mate, Simhadri Govindappa Since we announced the general availability of Apache Iceberg in Cloudera Data Platform (CDP), we are excited to see customers testing their analytic workloads on Iceberg. We will publish follow up blogs for other data services.

Data Warehouse 85

Data Warehouse Snapshot Metadata Cost-Benefit 85

Cloudera

MARCH 23, 2022

In fact, we recently announced the integration with our cloud ecosystem bringing the benefits of Iceberg to enterprises as they make their journey to the public cloud, and as they adopt more converged architectures like the Lakehouse. 1: Multi-function analytics . 4: Enterprise grade. Financial regulation. Reproducibility for ML Ops.

Metadata 95

Metadata Data Architecture Machine Learning Cost-Benefit 95

Corinium

APRIL 25, 2019

Ahead of the Chief Data Analytics Officers & Influencers, Insurance event we caught up with Dominic Sartorio, Senior Vice President for Products & Development, Protegrity to discuss how the industry is evolving. Why should Chief Data & Analytics Officers care about data security?

Insurance 150

Insurance Risk IoT Cost-Benefit 150

AWS Big Data

MARCH 3, 2023

In this post, we share how the AWS Data Lab helped Tricentis to improve their software as a service (SaaS) Tricentis Analytics platform with insights powered by Amazon Redshift. While aggregating, summarizing, and aligning to a common information model, all transformations must not affect the integrity of data from its source.

Software 52

Software Data Lake Testing Cost-Benefit 52

AWS Big Data

JUNE 21, 2023

In traditional databases, we would model such applications using a normalized data model (entity-relation diagram). A key pillar of AWS’s modern data strategy is the use of purpose-built data stores for specific use cases to achieve performance, cost, and scale. These types of queries are suited for a data warehouse.

Data Warehouse 81

Data Warehouse Data Lake OLAP Cost-Benefit 81

IBM Big Data Hub

SEPTEMBER 25, 2023

But what most people don’t realize is that behind the scenes, Uber is not just a transportation service; it’s a data and analytics powerhouse. Every day, millions of riders use the Uber app, unwittingly contributing to a complex web of data-driven decisions. Consider the magnitude of Uber’s footprint.

OLAP 87

OLAP Data Lake Data-driven Snapshot 87

AWS Big Data

JULY 28, 2023

Today, tens of thousands of customers run business-critical workloads on Amazon Redshift to cost-effectively and quickly analyze their data using standard SQL and existing business intelligence (BI) tools. Amazon Redshift now makes it easier for you to run queries in AWS data lakes by automatically mounting the AWS Glue Data Catalog.

Data Lake 68

Data Lake Data Governance Data Warehouse Modeling 68