Octopai

APRIL 19, 2021

Aptly named, metadata management is the process in which BI and Analytics teams manage metadata, which is the data that describes other data. In other words, data is the context and metadata is the content. Without metadata, BI teams are unable to understand the data’s full story.

Metadata 52

Metadata Management Business Intelligence Data Governance 52

AWS Big Data

OCTOBER 25, 2023

By some estimates, unstructured data can make up to 80–90% of all new enterprise data and is growing many times faster than structured data. After decades of digitizing everything in your enterprise, you may have an enormous amount of data, but with dormant value. The solution integrates data in three tiers.

Unstructured Data 121

Unstructured Data Metadata Management Analytics 121

DataKitchen

AUGUST 3, 2021

The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. Second-generation – gigantic, complex data lake maintained by a specialized team drowning in technical debt. Introduction to Data Mesh. See the pattern?

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

Cloudera

FEBRUARY 22, 2022

Over the past decade, the successful deployment of large scale data platforms at our customers has acted as a big data flywheel driving demand to bring in even more data, apply more sophisticated analytics, and on-board many new data practitioners from business analysts to data scientists.

Snapshot 107

Snapshot Metadata Cost-Benefit Data Architecture 107

Alation

MAY 31, 2023

This means that specialized roles such as data architects, which focus on modernizing data architecture to help meet business goals, are increasingly important to support data governance. What is a data architect? Their broad range of responsibilities include: Design and implement data architecture.

Data Governance 52

Data Governance Metadata Data Architecture Data Quality 52

Ontotext

JANUARY 10, 2024

Limiting growth by (data integration) complexity Most operational IT systems in an enterprise have been developed to serve a single business function and they use the simplest possible model for this. No matter what machine learning or graph algorithms are used, they cannot uncover dependencies if the corresponding “signals” are missing.

Metadata 72

Metadata Slice and Dice Data Integration Enterprise 72

Cloudera

MARCH 23, 2022

In fact, we recently announced the integration with our cloud ecosystem bringing the benefits of Iceberg to enterprises as they make their journey to the public cloud, and as they adopt more converged architectures like the Lakehouse. 1: Multi-function analytics . 3: Open Performance.

Metadata 90

Metadata Data Architecture Machine Learning Cost-Benefit 90

Ontotext

AUGUST 4, 2023

A data fabric utilizes an integrated data layer over existing, discoverable, and inferenced metadata assets to support the design, deployment, and utilization of data across enterprises, including hybrid and multi-cloud platforms. It also helps capture and connect data based on business or domains.

Metadata 52

Metadata Data-driven Data Architecture Data Quality 52

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 90

Strategy Data Architecture Cost-Benefit Reporting 90

Cloudera

JUNE 30, 2022

Today’s general availability announcement covers Iceberg running within key data services in the Cloudera Data Platform (CDP) — including Cloudera Data Warehousing ( CDW ), Cloudera Data Engineering ( CDE ), and Cloudera Machine Learning ( CML ). Why integrate Apache Iceberg with Cloudera Data Platform?

Data Lake 86

Data Lake Data Architecture Metadata Data Warehouse 86

AWS Big Data

DECEMBER 18, 2023

Amazon Redshift powers data-driven decisions for tens of thousands of customers every day with a fully managed, AI-powered cloud data warehouse, delivering the best price-performance for your analytics workloads. Learn more about the AWS zero-ETL future with newly launched AWS databases integrations with Amazon Redshift.

Data Warehouse 100

Data Warehouse Machine Learning Data-driven Data Lake 100

AWS Big Data

APRIL 29, 2024

The construction of big data applications based on open source software has become increasingly uncomplicated since the advent of projects like Data on EKS , an open source project from AWS to provide blueprints for building data and machine learning (ML) applications on Amazon Elastic Kubernetes Service (Amazon EKS).

Management 98

Management Big Data Metadata Data Warehouse 98

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 83

Management Metadata Data Architecture Data Lake 83

Ontotext

DECEMBER 1, 2023

Atanas Kiryakov presenting at KGF 2023 about Where Shall and Enterprise Start their Knowledge Graph Journey Only data integration through semantic metadata can drive business efficiency as “it’s the glue that turns knowledge graphs into hubs of metadata and content”.

Metadata 78

Metadata Sales Consulting Enterprise 78

CIO Business Intelligence

MARCH 24, 2023

The program must introduce and support standardization of enterprise data. Programs must support proactive and reactive change management activities for reference data values and the structure/use of master data and metadata.

Data Governance 142

Data Governance Management Metadata Data Quality 142

Cloudera

JUNE 7, 2022

We deliver cloud-native data analytics across the full data lifecycle – data distribution, data engineering, data warehousing, transactional data, streaming data, data science, and machine learning – that’s portable across infrastructures.

IT 110

IT Data Architecture Unstructured Data Big Data 110

Cloudera

JANUARY 5, 2023

Faced with even more pressure to remain resilient and agile amid looming global economic threats, Asia-Pacific (APAC) region businesses are looking to further mobilize emerging technologies such as artificial intelligence (AI) and machine learning that will optimize operational efficiencies and cost savings. .

Cost-Benefit 52

Cost-Benefit Business Objectives Machine Learning Data Architecture 52

AWS Big Data

NOVEMBER 15, 2023

It seamlessly consolidates data from various data sources within AWS, including AWS Cost Explorer (and forecasting with Cost Explorer ), AWS Trusted Advisor , and AWS Compute Optimizer. They can use their own toolsets or rely on provided blueprints to ingest the data from source systems.

Dashboards 97

Dashboards Analytics Metadata Data Warehouse 97

DataKitchen

AUGUST 8, 2023

Data Observability leverages five critical technologies to create a data awareness AI engine: data profiling, active metadata analysis, machine learning, data monitoring, and data lineage. Are problems with data tests? Which report tab is wrong? Which production job filled that report?

Data Quality 130

Data Quality Testing Snapshot Reporting 130

Cloudera

MARCH 17, 2023

As the use of ChatGPT becomes more prevalent, I frequently encounter customers and data users citing ChatGPT’s responses in their discussions. I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics.

Unstructured Data 62

Unstructured Data Data Lake Data Warehouse Machine Learning 62

AWS Big Data

NOVEMBER 29, 2023

Since then, customer demands for better scale, higher throughput, and agility in handling a wide variety of changing, but increasingly business critical analytics and machine learning use cases has exploded, and we have been keeping pace.

Data Warehouse 103

Data Warehouse Data Lake Analytics Machine Learning 103

CIO Business Intelligence

JUNE 23, 2022

We deliver cloud-native data analytics across the full data lifecycle – data distribution, data engineering, data warehousing, transactional data, streaming data, data science, and machine learning – that’s portable across infrastructures. Jonathan Takiff / IDG.

IT 83

IT Data Architecture Unstructured Data Big Data 83

AWS Big Data

JULY 14, 2023

In this post, we discuss how the Amazon Finance Automation team used AWS Lake Formation and the AWS Glue Data Catalog to build a data mesh architecture that simplified data governance at scale and provided seamless data access for analytics, AI, and machine learning (ML) use cases.

Finance 86

Finance Metadata Big Data Recreation/Entertainment 86

AWS Big Data

JANUARY 31, 2023

In this post, we are excited to summarize the features that the AWS Glue Data Catalog, AWS Glue crawler, and Lake Formation teams delivered in 2022. Whether you are a data platform builder, data engineer, data scientist, or any technology leader interested in data lake solutions, this post is for you.

Data Lake 84

Data Lake Data Governance Data Architecture Machine Learning 84

AWS Big Data

MARCH 7, 2024

At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. With this massive data growth, data proliferation across your data stores, data warehouse, and data lakes can become equally challenging.

Data Lake 115

Data Lake Analytics Dashboards Metrics 115

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. Metadata tables offer insights into the physical data storage layout of the tables and offer the convenience of querying them with Athena version 3.

Data Lake 90

Data Lake Analytics Snapshot Optimization 90

Alation

FEBRUARY 20, 2020

In a nod to AC/DC, a wink to Gartner’s research report, Data Catalogs Are the New Black in Data Management and Analytics , and inspiration from the inaugural Forrester Wave : Machine Learning Data Catalogs , we have temporarily set aside our Alation orange and have been rocking “black” for the Alation MLDC World Tour.

Machine Learning 52

Machine Learning Metadata Reporting Data-driven 52

AWS Big Data

APRIL 19, 2023

However, when a data producer shares data products on a data mesh self-serve web portal, it’s neither intuitive nor easy for a data consumer to know which data products they can join to create new insights. This is especially true in a large enterprise with thousands of data products.

Technology 85

Technology Data-driven Machine Learning Sales 85

Octopai

JULY 9, 2020

Your Guide to Machine Learning Data Lineage for BI: From Source to Target. Too often, data lineage is considered a linear course that does little more than reveal the route data took to arrive at its final destination. It required banks to develop a data architecture that could support risk-management tools.

Insurance 86

Insurance Risk Management Machine Learning Metadata 86

Cloudera

NOVEMBER 17, 2022

While Cloudera CDH was already a success story at HBL, in 2022, HBL identified the need to move its customer data centre environment from Cloudera’s CDH to Cloudera Data Platform (CDP) Private Cloud to accommodate growing volumes of data. See other customers’ success here .

Management 84

Management Data Lake Consulting Unstructured Data 84

Cloudera

OCTOBER 11, 2022

This leads to the obvious question – how do you do data at scale ? Al needs machine learning (ML), ML needs data science. Data science needs analytics. And they all need lots of data. First you need the data analytics, data management, and data science tools.

Snapshot 92

Snapshot Data Science Digital Transformation Metadata 92

Cloudera

JUNE 18, 2022

These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. In recent years, the term “data lakehouse” was coined to describe this architectural pattern of tabular analytics over data in the data lake.

Data Lake 92

Data Lake Data Warehouse Machine Learning Cost-Benefit 92

Alation

JANUARY 25, 2022

As a reminder, here’s Gartner’s definition of data fabric: “A design concept that serves as an integrated layer (fabric) of data and connecting processes. In this blog, we will focus on the “integrated layer” part of this definition by examining each of the key layers of a comprehensive data fabric in more detail.

Metadata 52

Metadata IT Metrics Data-driven 52

CIO Business Intelligence

JUNE 23, 2022

These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. In recent years, the term “data lakehouse” was coined to describe this architectural pattern of tabular analytics over data in the data lake.

Data Lake 90

Data Lake Data Warehouse Machine Learning Cost-Benefit 90

IBM Big Data Hub

JULY 13, 2023

Data science tasks such as machine learning also greatly benefit from good data integrity. When an underlying machine learning model is being trained on data records that are trustworthy and accurate, the better that model will be at making business predictions or automating tasks.

Data Quality 66

Data Quality Data Integration Metadata Cost-Benefit 66

Alation

APRIL 14, 2022

In today’s AI/ML-driven world of data analytics, explainability needs a repository just as much as those doing the explaining need access to metadata, EG, information about the data being used. The Cloud Data Migration Challenge. A data governance application with the ability to connect to data and security is needed.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

Cloudera

MAY 22, 2019

Although the program is technically in its seventh year, as the first joint awards program, this year’s Data Impact Awards will span even more use cases, covering even more advances in IoT, data warehouse, machine learning, and more. If you’ve democratized data within your company, we want to hear from you.

Machine Learning 56

Machine Learning Data Architecture IoT Metadata 56