AWS Big Data

AUGUST 16, 2023

Iceberg manages large collections of files as tables, and it supports modern analytical data lake operations such as record-level insert, update, delete, and time travel queries. Most businesses store their critical data in a data lake, where you can bring data from various sources to a centralized storage.

Data Lake 69

Data Lake Metadata Testing Snapshot 69

AWS Big Data

MARCH 7, 2023

A data hub contains data at multiple levels of granularity and is often not integrated. It differs from a data lake by offering data that is pre-validated and standardized, allowing for simpler consumption by users. Data hubs and data lakes can coexist in an organization, complementing each other.

Analytics 69

Analytics Data Warehouse Data Lake Metadata 69

AWS Big Data

OCTOBER 2, 2023

JSON data in Amazon Redshift Amazon Redshift enables storage, processing, and analytics on JSON data through the SUPER data type, PartiQL language, materialized views, and data lake queries. The function JSON_PARSE allows you to extract the binary data in the stream and convert it into the SUPER data type.

Cost-Benefit 85

Cost-Benefit Metadata Structured Data Management 85

Cloudera

OCTOBER 7, 2021

Those decentralization efforts appeared under different monikers through time, e.g., data marts versus data warehousing implementations (a popular architectural debate in the era of structured data) then enterprise-wide data lakes versus smaller, typically BU-Specific, “data ponds”.

Metadata 123

Metadata Cost-Benefit Enterprise Interactive 123

IBM Big Data Hub

JANUARY 18, 2023

In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution. Hence, Data Lake emerged, which handles unstructured and structured data with huge volume. Data discoverability. Yet another decade passed.

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

Alation

APRIL 6, 2023

Data governance is traditionally applied to structured data assets that are most often found in databases and information systems. This blog focuses on governing spreadsheets that contain data, information, and metadata, and must themselves be governed. Data catalogs and spreadsheets are related in many ways.

Data Governance 52

Data Governance Metadata Cost-Benefit Structured Data 52

erwin

AUGUST 31, 2023

Let’s explore the continued relevance of data modeling and its journey through history, challenges faced, adaptations made, and its pivotal role in the new age of data platforms, AI, and democratized data access. Embracing the future In the dynamic world of data, data modeling remains an indispensable tool.

Data-driven 98

Data-driven Modeling Enterprise Structured Data 98