AWS Big Data

APRIL 29, 2024

Effective permission management helps tackle these challenges by controlling how data is accessed and used, providing data integrity and minimizing the risk of data breaches. Apache Ranger is a comprehensive framework designed for data governance and security in Hadoop ecosystems.

Management 95

Management Big Data Metadata Data Warehouse 95

Jen Stirrup

MARCH 29, 2023

Organisations are looking at ways of simplifying data; for example, through simple rebranding efforts to disguise the complexity. However, SAP Datasphere goes much deeper deeper than a simple rebranding; it is the next generation of SAP Data Warehouse Cloud. They fail to get a grip on their data.

Metadata 120

Metadata Data Warehouse Data Integration Business Intelligence 120

erwin

FEBRUARY 28, 2024

One of the key ingredients to ensure data is really embedded in an organization, and one of the key enablers to increase the strategic impact of data, is the setup of a successful data governance program. Technology is an enabler, and for data governance this is essentially having an excellent metadata management tool.

Metadata 52

Metadata Data Governance Data Quality Technology 52

AWS Big Data

MARCH 26, 2024

In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges. Then, you transform this data into a concise format. The following screenshot shows an example C360 dashboard built on QuickSight.

Data Strategy 69

Data Strategy Strategy Data Warehouse Prescriptive Analytics 69

AWS Big Data

JANUARY 31, 2023

Data governance is the collection of policies, processes, and systems that organizations use to ensure the quality and appropriate handling of their data throughout its lifecycle for the purpose of generating business value.

Data Lake 79

Data Lake Data Governance Data Architecture Data Warehouse 79

AWS Big Data

DECEMBER 21, 2023

To speed up the self-service analytics and foster innovation based on data, a solution was needed to provide ways to allow any team to create data products on their own in a decentralized manner. To create and manage the data products, smava uses Amazon Redshift , a cloud data warehouse.

Data Lake 88

Data Lake Data Warehouse Data-driven B2B 88

Ontotext

NOVEMBER 16, 2023

Data mesh solves this by promoting data autonomy, allowing users to make decisions about domains without a centralized gatekeeper. It also improves development velocity with better data governance and access with improved data quality aligned with business needs. What Is a Data Product and Who Owns Them?

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

AWS Big Data

MARCH 10, 2023

They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. These transactional data lakes combine features from both the data lake and the data warehouse. Data can be organized into three different zones, as shown in the following figure.

Data Lake 102

Data Lake Sales Data Warehouse Snapshot 102

Cloudera

SEPTEMBER 15, 2022

The consumption of the data should be supported through an elastic delivery layer that aligns with demand, but also provides the flexibility to present the data in a physical format that aligns with the analytic application, ranging from the more traditional data warehouse view to a graph view in support of relationship analysis.

Data Lake 81

Data Lake Data Architecture Data-driven Data Warehouse 81

Ontotext

FEBRUARY 12, 2024

A centralized data engineering team focuses on building a governed self-serviced infrastructure, while domain teams use the services to build full-stack data products. However, data mesh is not about introducing new technologies.

Data-driven 59

Data-driven Data Lake Data Quality Business Objectives 59

AWS Big Data

JULY 21, 2023

This leads to having data across many instances of data warehouses and data lakes using a modern data architecture in separate AWS accounts. We recently announced the integration of Amazon Redshift data sharing with AWS Lake Formation. See Managing LF-Tags for metadata access control for more details.

Data Lake 84

Data Lake Data Warehouse Marketing Management 84

Alation

JULY 28, 2022

It’s costly and time-consuming to manage on-premises data warehouses — and modern cloud data architectures can deliver business agility and innovation. However, CIOs declare that agility, innovation, security, adopting new capabilities, and time to value — never cost — are the top drivers for cloud data warehousing.

Data Warehouse 69

Data Warehouse Cost-Benefit Data Governance Data-driven 69

TDAN

MAY 31, 2022

As we enter a new cloud-first era, advancements in technology have helped companies capture and capitalize on data as much as possible. Deciding between which cloud architecture to use has always been a debate between two options: data warehouses and data lakes.

Data Lake 52

Data Lake Data Warehouse Technology Data Architecture 52

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale.

Data Lake 113

Data Lake Metadata Optimization Statistics 113

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 89

Management Metadata Data Architecture Data Lake 89

Alation

APRIL 14, 2022

Semantics, context, and how data is tracked and used mean even more as you stretch to reach post-migration goals. This is why, when data moves, it’s imperative for organizations to prioritize data discovery. Data discovery is also critical for data governance , which, when ineffective, can actually hinder organizational growth.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

Alation

JANUARY 25, 2022

As a reminder, here’s Gartner’s definition of data fabric: “A design concept that serves as an integrated layer (fabric) of data and connecting processes. In this blog, we will focus on the “integrated layer” part of this definition by examining each of the key layers of a comprehensive data fabric in more detail.

Metadata 52

Metadata IT Metrics Data-driven 52

Alation

FEBRUARY 20, 2020

It’s no longer enough to build the data warehouse. Dave Wells, analyst with the Eckerson Group suggests that realizing the promise of the data warehouse requires a paradigm shift in the way we think about data along with a change in how we access and use it. Building the EDM.

Data Warehouse 52

Data Warehouse Metadata Data Lake Software 52

IBM Big Data Hub

AUGUST 4, 2023

Data democratization instead refers to the simplification of all processes related to data, from storage architecture to data management to data security. It also requires an organization-wide data governance approach, from adopting new types of employee training to creating new policies for data storage.

Data Architecture 65

Data Architecture Data Lake Machine Learning Data Governance 65

Alation

FEBRUARY 20, 2020

According to the report, “Demand for data catalogs is soaring as organizations struggle to inventory distributed data assets to facilitate data monetization and conform to regulations.” The tour stops at Gartner Symposium next month, where you can learn first hand why Gartner believes “Data Catalogs are the New Black.”.

Machine Learning 52

Machine Learning Metadata Reporting Data-driven 52

IBM Big Data Hub

JULY 5, 2023

Their fast adoption meant that customers soon lost track of what ended up in the data lake. And, just as challenging, they could not tell where the data came from, how it had been ingested nor how it had been transformed in the process. Data governance remains an unexplored frontier for this technology.

Data Lake 68

Data Lake Metadata Cost-Benefit Data Warehouse 68