Andrew White

JULY 5, 2023

I blogged recently about the high level of hype and confusion across Data and Analytics just a few months ago. Here is the original blog from March 2023: Summing Up Three Days at Gartner’s Data and Analytics Conference in Orlando, Florida, USA. Those are subsets of a much larger catalog. That is the wrong question.

Metrics 52

Metrics Metadata Modeling Data Quality 52

AWS Big Data

APRIL 26, 2024

To enable your workforce users for analytics with fine-grained data access controls and audit data access, you might have to create multiple AWS Identity and Access Management (IAM) roles with different data permissions and map the workforce users to one of those roles. We use Okta as the IdP for this demonstration.

Analytics 94

Analytics Data Lake Management Enterprise 94

AWS Big Data

MARCH 4, 2024

As enterprises collect increasing amounts of data from various sources, the structure and organization of that data often need to change over time to meet evolving analytical needs. Schema evolution enables adding, deleting, renaming, or modifying columns without needing to rewrite existing data. Query the data using Athena.

Snapshot 111

Snapshot Data Lake Metadata Recreation/Entertainment 111

AWS Big Data

NOVEMBER 17, 2023

Athena provides a simplified, flexible way to analyze petabytes of data where it lives. You can analyze data or build applications from an Amazon Simple Storage Service (Amazon S3) data lake and 30 data sources, including on-premises data sources or other cloud systems using SQL or Python.

Optimization 112

Optimization Statistics Metadata Data Lake 112

Rocket-Powered Data Science

FEBRUARY 15, 2023

First, don’t do something just because everyone else is doing it – there needs to be a valid business reason for your organization to be doing it, at the very least because you will need to explain it objectively to your stakeholders (employees, investors, clients). So what? (2)

Strategy 289

Strategy Experimentation Uncertainty Machine Learning 289

Octopai

JUNE 27, 2022

Sit back and imagine how you would feel when…. This data catalog is helping boost our bottom line.”. Your data team spends more time doing high-level analysis than it does searching for relevant datasets. Data catalog SUCCESS! Pick a data catalog that matches your enterprise’s needs.

Management 72

Management Metadata Visualization Data Governance 72

Octopai

DECEMBER 20, 2021

Data under construction. Today, we build with data. With data, we construct analyses of what happened and predictions of what will happen. With data, we create satisfying customer experiences. With data, we build the revenue and profit of our company. With data, we build the revenue and profit of our company.

Metadata 87

Metadata Reporting Enterprise Optimization 87

Cloudera

MARCH 14, 2023

We just announced the general availability of Cloudera DataFlow Designer , bringing self-service data flow development to all CDP Public Cloud customers. In this blog post we will put these capabilities in context and dive deeper into how the built-in, end-to-end data flow life cycle enables self-service data pipeline development.

Testing 81

Testing Publishing Metadata Interactive 81

AWS Big Data

MARCH 29, 2024

QuickSight makes it straightforward for business users to visualize data in interactive dashboards and reports. You can slice data by different dimensions like job name, see anomalies, and share reports securely across your organization. With these insights, teams have the visibility to make data integration pipelines more efficient.

Metrics 104

Metrics Visualization Dashboards Interactive 104

AWS Big Data

JANUARY 27, 2023

To build a data-driven business, it is important to democratize enterprise data assets in a data catalog. With a unified data catalog, you can quickly search datasets and figure out data schema, data format, and location. For metadata read/write, Flink has the catalog interface.

Data Lake 61

Data Lake Metadata Business Analysis Data-driven 61

AWS Big Data

MARCH 2, 2023

It adds tables to compute engines including Spark, Trino, PrestoDB, Flink, and Hive using a high-performance table format that works just like a SQL table. Iceberg has become very popular for its support for ACID transactions in data lakes and features like schema and partition evolution, time travel, and rollback. AWS Glue 3.0

Data Lake 116

Data Lake Data Processing Metadata Snapshot 116

Alation

JULY 26, 2021

How do you initiate change within a system containing many thousands of people and millions of bytes of data? During my time as a data specialist at American Family Insurance, it became clear that we had to move away from the way things had been done in the past. So you can probably imagine: The company manages a lot of data.

Insurance 98

Insurance Digital Transformation Enterprise Data Governance 98

Octopai

JANUARY 31, 2022

If you’re a mystery lover, I’m sure you’ve read that classic tale: Sherlock Holmes and the Case of the Deceptive Data, and you know how a metadata catalog was a key plot element. In The Case of the Deceptive Data, Holmes is approached by B.I. He goes on to explain: Reasons for inaccurate data. Big data is BIG.

Metadata 77

Metadata IT Unstructured Data IoT 77

Octopai

JUNE 30, 2022

Increasing data quality and accuracy? Why are data catalog use cases so downright… predictable? If you can rattle off the top five or ten enterprise data catalog use cases in your sleep, this post is an attempt to add a little more color and variety to your data life. The data catalog as an HR tool?

Enterprise 72

Enterprise Data-driven Data Lake Data Quality 72

AWS Big Data

OCTOBER 9, 2023

Data lakes have been gaining popularity for storing vast amounts of data from diverse sources in a scalable and cost-effective way. As the number of data consumers grows, data lake administrators often need to implement fine-grained access controls for different user profiles.

Data Lake 120

Data Lake Testing Big Data Management 120

CIO Business Intelligence

SEPTEMBER 6, 2022

When Steve Pimblett joined The Very Group in October 2020 as chief data officer, reporting to the conglomerate’s CIO, his task was to help the enterprise uncover value in its rich data heritage. Very grew from the successive mergers of a number of mail order catalog companies, the oldest dating back to the 1890s.

IT 82

IT Forecasting Data Lake Enterprise 82

Octopai

OCTOBER 11, 2021

On a scale of 1 to 10, rate the difficulty of the following tasks: Searching for a needle in a haystack Finding an earring that fell off in the Mall of America Tracking down every appearance of a given customer’s birthdate amongst 100K+ data assets across your entire BI landscape. You collect data to use it. Use it or lose it.

Metadata 90

Metadata Data Collection Optimization IT 90

Octopai

OCTOBER 5, 2021

Your CFO finally gave the okay to purchase data catalog software. When you’ve cleaned up the confetti and the cocktail glasses, it’s time to get down to business. How will you choose the best data catalog software for your company? Does it support automatic harvesting from your other data/BI software?

Business Intelligence 84

Business Intelligence Software Cost-Benefit Metadata 84

BI-Survey

JUNE 30, 2023

dScribe data is an innovative start-up from Belgium that offers a data catalog focusing on easy implementation, maintenance and usage. dScribe sees lack of user adoption as the main reason for the failure of data catalog projects. When should I consider looking into the solution? Who is dScribe?

Key Performance Indicator 52

Key Performance Indicator Metadata Marketing Data Quality 52

Alation

NOVEMBER 15, 2022

Digital transformation or a change in a company’s mindset to embrace data is an important step towards becoming a truly data intelligent and more efficient business. And a data catalog is an important part of this. Good news: You don’t need any prerequisites to implement Alation Data Catalog.

Digital Transformation 52

Digital Transformation Software IT 52

Octopai

OCTOBER 8, 2020

Have you come across the data ‘buzzwords’ data dictionary, business glossary, and catalog? These tools refine data which helps you better understand trends, insights, and even locate errors. Creating a foolproof way to sift-through and derive insights from the mountains of data we acquire is truly an uphill battle.

Metadata 96

Metadata Reporting Management Business Intelligence 96

Alation

MAY 12, 2023

So when leading software review site TrustRadius announced that we had won their “Top Rated” awards in Data Catalog , Data Collaboration, Data Governance , and Metadata Management we were thrilled, but not surprised, since usability has been core to Alation’s product DNA since day 1.

Metadata 52

Metadata Data Governance Data-driven Sales 52

AWS Big Data

APRIL 2, 2024

In March 2024, we announced the general availability of the generative artificial intelligence (AI) generated data descriptions in Amazon DataZone. In this post, we share what we heard from our customers that led us to add the AI-generated data descriptions and discuss specific customer use cases addressed by this capability.

Metadata 87

Metadata Metrics Data-driven Modeling 87

Alation

JANUARY 24, 2023

Most organisations are seeking to be data-driven because they believe in the value of data to inform key decisions at all levels, making data management absolutely critical. Business leaders already know about the importance of building a data culture in their organisation, and many have long since embarked on that journey.

Metadata 52

Metadata Data-driven Data Governance Metrics 52

erwin

JANUARY 3, 2020

Understanding the data governance trends for the year ahead will give business leaders and data professionals a competitive edge … Happy New Year! Regulatory compliance and data breaches have driven the data governance narrative during the past few years. To that end, data is finally no longer just an IT issue.

Data Governance 139

Data Governance Digital Transformation IoT Metadata 139

CIO Business Intelligence

NOVEMBER 21, 2023

After all, 41% of employees acquire, modify, or create technology outside of IT’s visibility , and 52% of respondents to EY’s Global Third-Party Risk Management Survey had an outage — and 38% reported a data breach — caused by third parties over the past two years. That’s not to downplay the inherent risks of shadow IT.

IT 131

IT Risk Cost-Benefit Risk Management 131

AWS Big Data

JANUARY 31, 2023

Data governance is the collection of policies, processes, and systems that organizations use to ensure the quality and appropriate handling of their data throughout its lifecycle for the purpose of generating business value.

Data Lake 79

Data Lake Data Governance Data Architecture Data Warehouse 79

Alation

APRIL 19, 2021

The cloud supports this new workforce, connecting remote workers to vital data, no matter their location. Data Cloud Migration Challenges and Solutions. Cloud migration is the process of moving enterprise data and infrastructure from on premise to off premise. However, cloud data migration can be difficult.

Cost-Benefit 111

Cost-Benefit Strategy Enterprise Data Strategy 111

Jet Global

NOVEMBER 29, 2023

Today the average person receives 107 emails but just 2 pieces of mail per day. Think about when you receive a greeting card in the mail or, rarer still, a personal letter. You might smile when you find it. A printed flyer or catalog is likely to be retained for 17 days. Consumer Data Security Laws are on the rise.

Marketing 52

Marketing Cost-Benefit Interactive Testing 52

Alation

JANUARY 10, 2023

When considering implementing any new tool or software, the first thing many organisations will ask is what is the value add. And implementing a data catalog is no different. But the actual value you can get out of a data catalog will depend somewhat on the reason you’re looking to implement one in the first place.

ROI 52

ROI Data Lake Strategy Data-driven 52

IBM Big Data Hub

FEBRUARY 12, 2024

Recognizing the need to harness real-time data, businesses are increasingly turning to event-driven architecture (EDA) as a strategic approach to stay ahead of the curve. This trend grows stronger as organizations realize the benefits that come from the power of real-time data streaming.

Data-driven 86

Data-driven Cost-Benefit Uncertainty Technology 86

Alation

DECEMBER 15, 2022

Among all the internal celebrations, I wanted to take this moment to reflect on our journey so far and ask a thought-provoking question: who is the GOAT of data catalogs ? While often a heavily debated topic, most would agree that just like every story needs a hero, every pursuit needs a GOAT. What Is a GOAT?

Metadata 52

Metadata Data Governance Data Quality Marketing 52

Alation

JUNE 20, 2023

After its 2021 acquisition of Heights Finance Corporation, CURO needed to catalog and tag its legacy data while integrating Heights’ data — quickly. Bringing together companies — and their data Alation: For you guys in data, it sounds like the acquisition was the easy part. Then the real work began. Will: Right.

Technology 52

Technology Data Governance Data Warehouse Software 52

AWS Big Data

MARCH 27, 2024

This includes patient medical history, allergies, immunizations, family disease history, and individuals’ lifestyle data such as workout habits. AWS has invested in a zero-ETL (extract, transform, and load) future so that builders can focus more on creating value from data, instead of having to spend time preparing data for analysis.

Data Analytics 90

Data Analytics Analytics Data Warehouse Data Lake 90

Andrew White

NOVEMBER 14, 2022

Too many firms have been sold a catalog or marketplace in support of a governance program. As a result those firms are turning off the catalogs and struggling to get control of the program. The State of Play with Data and Analytics Governance. Many organizations are doing just that. To Catalog or Not to Catalog?

Data Integration 52

Data Integration Technology Data Governance Analytics 52

IBM Big Data Hub

MAY 9, 2024

The healthcare industry faces arguably the highest stakes when it comes to data governance. For starters, healthcare organizations constantly encounter vast (and ever-increasing) amounts of highly regulated personal data. healthcare, managing the accuracy, quality and integrity of data is the focus of data governance.

Data Governance 74

Data Governance Data Quality Insurance Predictive Analytics 74

AWS Big Data

JULY 20, 2023

Apache Hive is a SQL-based data warehouse system for processing highly distributed datasets on the Apache Hadoop platform. The Hive metastore is a repository of metadata about the SQL tables, such as database names, table names, schema, serialization and deserialization information, data location, and partition details of each table.

Data Lake 77

Data Lake Metadata Data Processing Big Data 77