Cloudera

SEPTEMBER 15, 2022

July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. A key area of focus for the symposium this year was the design and deployment of modern data platforms. What is a data fabric?

Data Lake 79

Data Lake Data Architecture Data-driven Data Warehouse 79

DataKitchen

NOVEMBER 29, 2021

Keep an eye on the eight top trends below that we believe will be significant in the year 2022. The data industry realizes that AI bias is simply a quality problem, and AI systems should be subject to this same level of process control as an automobile rolling off an assembly line. Data Gets Meshier. Data Gets Meshier.

Testing 245

Testing Data Lake Data Architecture Manufacturing 245

AWS Big Data

OCTOBER 19, 2023

Data lakes and data warehouses are two of the most important data storage and management technologies in a modern data architecture. Data lakes store all of an organization’s data, regardless of its format or structure.

Data Lake 117

Data Lake Data Warehouse Visualization Snapshot 117

IBM Big Data Hub

JULY 5, 2022

In today’s world of complex data architectures and emerging technologies, databases can sometimes be undervalued and unrecognized. When we look ahead, that same architectural foundation we have spent decades perfecting and innovating is also bringing Db2 into future. Vektis improves healthcare quality through data .

Data Lake 94

Data Lake Data Warehouse Publishing Structured Data 94

Alation

NOVEMBER 2, 2022

And that’s even in the midst of 2022, which has been a tumultuous year from a macro perspective. We had not seen that in the broader intelligence & data governance market.”. Right now, it’s probably not a secret that the amount and the pace of financings – if you compare 2022 to 2021 – is night and day,” he continues.

Data Governance 98

Data Governance Marketing Finance Data Lake 98

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale.

Data Lake 120

Data Lake Metadata Optimization Statistics 120

AWS Big Data

JULY 21, 2023

This leads to having data across many instances of data warehouses and data lakes using a modern data architecture in separate AWS accounts. We recently announced the integration of Amazon Redshift data sharing with AWS Lake Formation. Take note of this role’s ARN to use later in the steps.

Data Lake 89

Data Lake Data Warehouse Marketing Management 89

AWS Big Data

MAY 18, 2023

It’s even harder when your organization is dealing with silos that impede data access across different data stores. Seamless data integration is a key requirement in a modern data architecture to break down data silos. AWS Glue released version 4.0 runtime ( 3.5

Testing 82

Testing Data Lake Cost-Benefit Data Integration 82

CIO Business Intelligence

APRIL 4, 2023

In order to move AI forward, we need to first build and fortify the foundational layer: data architecture. This architecture is important because, to reap the full benefits of AI, it must be built to scale across an enterprise versus individual AI applications. Constructing the right data architecture cannot be bypassed.

Data Architecture 52

Data Architecture Data Lake Data Warehouse Cost-Benefit 52

CIO Business Intelligence

SEPTEMBER 21, 2023

The world has flipped since 2022,” says David McCurdy, chief enterprise architect and CTO at Insight. To make all this possible, the data had to be collected, processed, and fed into the systems that needed it in a reliable, efficient, scalable, and secure way. Then gen AI came out.

Enterprise 130

Enterprise Consulting Modeling Cost-Benefit 130

AWS Big Data

APRIL 19, 2023

Every day, customers are challenged with how to manage their growing data volumes and operational costs to unlock the value of data for timely insights and innovation, while maintaining consistent performance. As data workloads grow, costs to scale and manage data usage with the right governance typically increase as well.

Data Warehouse 57

Data Warehouse Data Lake Unstructured Data Optimization 57

Cloudera

NOVEMBER 17, 2022

The Solution: CDP Private Cloud brings a next-generation hybrid architecture with cloud-native benefits to HBL’s data platform. HBL started their data journey in 2019 when data lake initiative was started to consolidate complex data sources and enable the bank to use single version of truth for decision making.

Management 82

Management Data Lake Consulting Unstructured Data 82

Cloudera

JUNE 30, 2022

In February 2022, we introduced Apache Iceberg as a technical preview within CDP. Over the past decade, Cloudera has enabled multi-function analytics on data lakes through the introduction of the Hive table format and Hive ACID. We selected change data capture as our first use case on Iceberg.

Data Lake 84

Data Lake Data Architecture Metadata Data Warehouse 84

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 86

Management Metadata Data Architecture Data Lake 86

CIO Business Intelligence

JANUARY 30, 2024

As the internal technology provider for parent company Allianz SE with 15,000 employees, the entity employs more than 100 ESG experts who spend several weeks each year heads down collecting and reporting ESG data manually. Karcher has since built a team of 18 and completed an inventory of existing ESG data structures and legal requirements.

Reporting 115

Reporting Data Quality Strategy Data-driven 115

AWS Big Data

MARCH 3, 2023

Building data lakes from continuously changing transactional data of databases and keeping data lakes up to date is a complex task and can be an operational challenge. You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes.

Data Lake 86

Data Lake Dashboards Metrics Metadata 86

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In 2022, AWS commissioned a study conducted by the American Productivity and Quality Center (APQC) to quantify the Business Value of Customer 360.

Data Strategy 74

Data Strategy Strategy Data Warehouse Prescriptive Analytics 74

Alation

JULY 7, 2022

In the 2010s, the growing scope of the data landscape gave rise to a new profession: the data scientist. This new role, combined with the creation of data lakes and the increasing use of cloud services, created new employment opportunities in data analytics, data architecture, and data management.

Metadata 52

Metadata Data-driven Insurance Statistics 52

AWS Big Data

APRIL 20, 2023

In a modern data architecture, unified analytics enable you to access the data you need, whether it’s stored in a data lake or a data warehouse. AWS Glue provides an extensible architecture that enables users with different data processing use cases, and works well with Amazon Redshift.

Visualization 82

Visualization Data Warehouse Big Data Data Lake 82

BI-Survey

JANUARY 15, 2023

Data architecture is a topic that is as relevant today as ever. It is widely regarded as a matter for data engineers, not business domain experts. Statements from countless interviews with our customers reveal that the data warehouse is seen as a “black box” by many and understood by few business users. But is it really?

Data Warehouse 52

Data Warehouse IT Data Architecture Measurement 52

AWS Big Data

DECEMBER 21, 2023

To bring their customers the best deals and user experience, smava follows the modern data architecture principles with a data lake as a scalable, durable data store and purpose-built data stores for analytical processing and data consumption.

Data Lake 97

Data Lake Data Warehouse Data-driven B2B 97

CIO Business Intelligence

JANUARY 20, 2023

A big part of preparing data to be shared is an exercise in data normalization, says Juan Orlandini, chief architect and distinguished engineer at Insight Enterprises. Data formats and data architectures are often inconsistent, and data might even be incomplete. They have data swamps,” he says.

Data Lake 135

Data Lake Data-driven Finance Data Architecture 135

AWS Big Data

APRIL 5, 2023

Showpad also struggled with data quality issues in terms of consistency, ownership, and insufficient data access across its targeted user base due to a complex BI access process, licensing challenges, and insufficient education. Showpad completed its internal BI migration to QuickSight by the end of 2022.

Dashboards 52

Dashboards Reporting Cost-Benefit Visualization 52