Andrew White

JULY 5, 2023

I blogged recently about the high level of hype and confusion across Data and Analytics just a few months ago. Here is the original blog from March 2023: Summing Up Three Days at Gartner’s Data and Analytics Conference in Orlando, Florida, USA. Those are subsets of a much larger catalog. That is the wrong question.

Metrics 52

Metrics Metadata Modeling Data Quality 52

Octopai

APRIL 19, 2021

Aptly named, metadata management is the process in which BI and Analytics teams manage metadata, which is the data that describes other data. In other words, data is the context and metadata is the content. Without metadata, BI teams are unable to understand the data’s full story. TDWI – David Loshin.

Metadata 52

Metadata Management Business Intelligence Data Governance 52

AWS Big Data

MARCH 2, 2023

Iceberg has become very popular for its support for ACID transactions in data lakes and features like schema and partition evolution, time travel, and rollback. Iceberg has become very popular for its support for ACID transactions in data lakes and features like schema and partition evolution, time travel, and rollback. AWS Glue 3.0

Data Lake 116

Data Lake Data Processing Metadata Snapshot 116

Alation

JULY 15, 2021

Many data catalog initiatives fail. How can prospective buyers ensure they partner with the right catalog to drive success? According to the latest report from Eckerson Group, Deep Dive on Data Catalogs , shoppers must match the goals of their organizations to the capabilities of their chosen catalog.

Reporting 98

Reporting Data Governance Recreation/Entertainment Metadata 98

Alation

JANUARY 20, 2022

Several weeks ago (prior to the Omicron wave), I got to attend my first conference in roughly two years: Dataversity’s Data Quality and Information Quality Conference. Ryan Doupe, Chief Data Officer of American Fidelity, held a thought-provoking session that resonated with me. But what about governance rules that enforce quality?

Data Quality 94

Data Quality Data Governance Metrics Statistics 94

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

Alation

NOVEMBER 15, 2022

Digital transformation or a change in a company’s mindset to embrace data is an important step towards becoming a truly data intelligent and more efficient business. And a data catalog is an important part of this. But what does your company need to do to achieve this?

Digital Transformation 52

Digital Transformation Software IT 52

Alation

JUNE 14, 2021

The Role of Catalog in Data Security. Recently, I dug in with CIOs on the topic of data security. Recently, I dug in with CIOs on the topic of data security. What came as no surprise was the importance CIOs place on taking a broader approach to data protection. So CISOs must protect data.

Data Governance 97

Data Governance Recreation/Entertainment Data Lake Digital Transformation 97

IBM Big Data Hub

JANUARY 26, 2024

To succeed in the modern era, CSPs need versatile teams, including data scientists for data interpretation and operations, software developers for automation through vendor application programming interfaces (API) and service assurance engineers for designing closed loops to ensure service reliability.

IoT 106

IoT Data-driven Interactive Management 106

Ontotext

APRIL 10, 2024

The data ecosystem today is crowded with dazzling buzzwords, all fighting for investment dollars. A survey in 2021 found that a data company was being funded every 45 minutes. Data ecosystems have become jungles and in spite of all the technology, data teams are struggling to create a modern data experience.

Metadata 52

Metadata Data Lake Data Warehouse Data Quality 52

Alation

JULY 26, 2021

How do you initiate change within a system containing many thousands of people and millions of bytes of data? During my time as a data specialist at American Family Insurance, it became clear that we had to move away from the way things had been done in the past. So you can probably imagine: The company manages a lot of data.

Insurance 98

Insurance Digital Transformation Enterprise Data Governance 98

Cloudera

JULY 18, 2022

In part 1 of this blog we discussed how Cloudera DataFlow for the Public Cloud (CDF-PC), the universal data distribution service powered by Apache NiFi, can make it easy to acquire data from wherever it originates and move it efficiently to make it available to other applications in a streaming fashion. Data decays!

Analytics 86

Analytics Dashboards Statistics Visualization 86

Cloudera

JUNE 7, 2021

Since then, we have been working hard to expose the full power of Apache Flink SQL and the existing Data Warehousing tools in CDP to combine it into a state-of-the-art real-time analytics platform. Flink SQL DDL and Catalog support. Catalog Integrations. This step significantly speeds up query development and data exploration.

Analytics 101

Analytics Management IT 101

erwin

JUNE 26, 2020

If you’re serious about a data-driven strategy , you’re going to need a data catalog. Organizations need a data catalog because it enables them to create a seamless way for employees to access and consume data and business assets in an organized manner. Three Types of Metadata in a Data Catalog.

Metadata 132

Metadata Cost-Benefit Measurement Data-driven 132

Alation

DECEMBER 21, 2022

Master Data Management (MDM) and data catalog growth are accelerating because organizations must integrate more systems, comply with privacy regulations, and address data quality concerns. What Is Master Data Management (MDM)? Data Catalog and Master Data Management. Identify Resources.

Management 52

Management Data Quality Metadata Testing 52

Alation

JANUARY 24, 2023

Most organisations are seeking to be data-driven because they believe in the value of data to inform key decisions at all levels, making data management absolutely critical. Business leaders already know about the importance of building a data culture in their organisation, and many have long since embarked on that journey.

Metadata 52

Metadata Data-driven Data Governance Metrics 52

Alation

JULY 19, 2021

What Is Metadata? Metadata is information about data. A clothing catalog or dictionary are both examples of metadata repositories. Indeed, a popular online catalog, like Amazon, offers rich metadata around products to guide shoppers: ratings, reviews, and product details are all examples of metadata. Types of Metadata.

Metadata 105

Metadata Management Data Governance Machine Learning 105

IBM Big Data Hub

MAY 9, 2023

These events can provide a wealth of information about what’s actually happening across your business at any moment in time. First, events can be locked away across a variety of different data sources, applications and systems. First, events can be locked away across a variety of different data sources, applications and systems.

Business Intelligence 106

Business Intelligence Data-driven Marketing Enterprise 106

IBM Big Data Hub

AUGUST 2, 2023

Companies rely heavily on data and analytics to find and retain talent, drive engagement, and improve productivity. However, analytics are only as good as the quality of the data, which aims to be error-free, trustworthy, and transparent. According to a Gartner report , poor data quality costs organizations an average of USD $12.9

Data Quality 65

Data Quality Snapshot Data Governance Data-driven 65

Alation

MARCH 2, 2023

Instead, we got data. Lots and lots of data. It does feel, however, as if we need jet-like speed to analyze and understand our data, who is using it, how it is used, and if it is being used to drive value. This is because simply collecting data leaves it open to misinterpretation, misuse, and decay.

Metadata 52

Metadata Marketing IT Data Quality 52

AWS Big Data

JUNE 6, 2023

Data is the lifeblood of modern businesses. In today’s data-driven world, companies rely on data to make informed decisions, gain a competitive edge, and provide exceptional customer experiences. However, not all data is created equal. AWS Glue Data Quality measures and monitors the quality of your dataset.

Data Quality 67

Data Quality Data Lake Visualization Data-driven 67

Alation

MARCH 11, 2022

So far, we’ve considered the rivalry of data fabric versus mesh. We’ve explored what is a data fabric , what is a data mesh , and how a data catalog supports these architectures. In this blog, we’ll tease three high-level tips and takeaways. First thing: Data is a powerful asset.

Metadata 52

Metadata Data Governance ROI Data Quality 52

Alation

NOVEMBER 4, 2022

In business, data-based goals tend to be very tangible. Perhaps you want to boost your ROI or CAGR, or reduce the time your analysts spend accessing and leveraging data. In this blog we’ll describe digital transformation: how it can be achieved as well as how it can benefit your business. But first you need to define them.

Digital Transformation 52

Digital Transformation Cost-Benefit Insurance Machine Learning 52

Alation

DECEMBER 15, 2022

Among all the internal celebrations, I wanted to take this moment to reflect on our journey so far and ask a thought-provoking question: who is the GOAT of data catalogs ? What Is a GOAT? These select athletes are determined by what the “market” is saying – this includes fans, analysts, and the press.

Metadata 52

Metadata Data Governance Data Quality Marketing 52

Alation

DECEMBER 29, 2022

In business — and even in life — you can be so focused on “What’s next?” that it’s easy to forget to ask “What happened?” The 2022 Data Catalog Wasn’t Your 2021 Data Catalog. The Alation Data Catalog our customers currently use has evolved from when the year began. It can also tell stories.

Data Governance 52

Data Governance Data Quality Data-driven Data Processing 52

Alation

APRIL 19, 2021

The cloud supports this new workforce, connecting remote workers to vital data, no matter their location. And what are the benefits? Data Cloud Migration Challenges and Solutions. Cloud migration is the process of moving enterprise data and infrastructure from on premise to off premise. But why migrate at all?

Cost-Benefit 111

Cost-Benefit Strategy Enterprise Data Strategy 111

IBM Big Data Hub

JUNE 12, 2023

Companies rely heavily on data and analytics to find and retain talent, drive engagement, improve productivity and more across enterprise talent management. However, analytics are only as good as the quality of the data, which must be error-free, trustworthy and transparent. What is data quality? million each year.

Data Quality 68

Data Quality Data Governance People Analytics Data-driven 68

Alation

APRIL 14, 2023

Last week, the Alation team had the privilege of joining IT professionals, business leaders, and data analysts and scientists for the Modern Data Stack Conference in San Francisco. The show floor was buzzing with industry experts, networking and sharing valuable insights on the latest developments in the data space.

Data Warehouse 52

Data Warehouse Digital Transformation Data-driven Metadata 52

IBM Big Data Hub

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

AWS Big Data

JUNE 6, 2023

We are excited to announce the General Availability of AWS Glue Data Quality. Our journey started by working backward from our customers who create, manage, and operate data lakes and data warehouses for analytics and machine learning. To make confident business decisions, the underlying data needs to be accurate and recent.

Data Quality 93

Data Quality Statistics Data Lake Visualization 93

Alation

NOVEMBER 17, 2022

But what does it mean for an organisation to be truly data-driven? What foundation needs to be in place at the start, and what journey does an organisation need to embrace to benefit from the forensic insights their data can reveal? First, what are your business objectives? Keeping those customers (6 times).

Data-driven 52

Data-driven Cost-Benefit Business Objectives Technology 52

IBM Big Data Hub

MAY 9, 2023

Over the past decade, deep learning arose from a seismic collision of data availability and sheer compute power, enabling a host of impressive AI capabilities. Data must be laboriously collected, curated, and labeled with task-specific annotations to train AI models. We stand on the frontier of an AI revolution.

Enterprise 134

Enterprise Technology Modeling Cost-Benefit 134

Cloudera

DECEMBER 11, 2020

In a previous blog post on CDW performance, we compared Azure HDInsight to CDW. In this blog post, we compare Cloudera Data Warehouse (CDW) on Cloudera Data Platform (CDP) using Apache Hive-LLAP to EMR 6.0 (also powered by Apache Hive-LLAP) on Amazon using the TPC-DS 2.9 More on this later in the blog.

Data Warehouse 106

Data Warehouse Metadata Machine Learning Measurement 106

Cloudera

DECEMBER 1, 2022

Full-stack observability is a critical requirement for effective modern data platforms to deliver the agile, flexible, and cost-effective environment organizations are looking for. RI is a global leader in the design and deployment of large-scale, production-level modern data platforms for the world’s largest enterprises.

Metrics 82

Metrics Data Quality Data Lake Statistics 82

Cloudera

NOVEMBER 23, 2020

Upgrading components of Cloudera Data Warehouse (CDW) is as easy as one decision and a few clicks. While the Database (DB) Catalog and Virtual Warehouses (VWs) need to be compatible, the CDW upgrade framework understands the interoperability constraints between them. . For DB Catalogs, it means that no upgrades are needed for its VWs.

Metadata 65

Metadata Data Warehouse Visualization Publishing 65

Alation

AUGUST 18, 2022

How do you approach data lineage? We all know that data lineage is a complex and challenging topic. In this blog, I am drilling into something I’ve been thinking about and studying for a long time: fundamental approaches to lineage creation and maintenance. What Is Data Lineage Creation & Maintenance?

Metadata 69

Metadata Visualization Statistics Data Architecture 69

AWS Big Data

OCTOBER 3, 2023

In our previous post Improve operational efficiencies of Apache Iceberg tables built on Amazon S3 data lakes , we discussed how you can implement solutions to improve operational efficiencies of your Amazon Simple Storage Service (Amazon S3) data lake that is using the Apache Iceberg open table format and running on the Amazon EMR big data platform.

Optimization 108

Optimization Snapshot Data Lake Metadata 108