CIO Business Intelligence

MARCH 4, 2024

The data mesh debate This is not to say that there is a consensus that data mesh is a universal solution. Stakeholders are currently waging an open debate across the industry of centralization versus federated data strategies.

Insurance 98

Insurance Strategy Data Governance Data Integration 98

CIO Business Intelligence

OCTOBER 13, 2023

A sampling of data architect job descriptions shows key areas of responsibility such as: creating a DataOps and BI transformation roadmap, developing and sustaining a data strategy, implementing and optimizing physical database design, and designing and implementing data migration and integration processes.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

TDAN

JUNE 18, 2019

Is your organization struggling to succeed with your Data Governance program? Is adoption by the business an issue for you? Data Governance occurs best when done in conjunction with the business processes and not as a “bolt on”/additional activity.

Data Governance 56

Data Governance Metadata Data Strategy Business Intelligence 56

CIO Business Intelligence

DECEMBER 16, 2022

These included metadata design and development, quantitative analysis, regression analysis, continuous integration, data analytics, data strategy, identity and access management, machine learning, natural language processing, and more.

Testing 98

Testing Metadata Data Processing Machine Learning 98

TDAN

DECEMBER 20, 2022

Over the past few months, my team in Castlebridge and I have been working with clients delivering training to business and IT teams on data management skills like data governance, data quality management, data modelling, and metadata management.

Metadata 52

Metadata Data Governance Data Quality Management 52

CIO Business Intelligence

JUNE 23, 2022

In our very own Enterprise Data Maturity research surveying over 3,000 IT and senior business leaders, we found that 40% of organizations are currently running hybrid but mostly on-premises, and 36% of respondents expect to shift to hybrid multi-cloud in the next 18 months. Where data flows, ideas follow.

IT 96

IT Data Architecture Unstructured Data Big Data 96

CIO Business Intelligence

MARCH 21, 2022

Businesses typically rely on keywords to make sense of unstructured data to pull out relevant data using searchable terms. Semi-structured data falls between the two. It doesn’t conform to a data model but does have associated metadata that can be used to group it.

Unstructured Data 137

Unstructured Data Data Analytics Analytics Structured Data 137

AWS Big Data

MARCH 10, 2023

However, as data processing at scale solutions grow, organizations need to build more and more features on top of their data lakes. They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. The Iceberg table is synced with the AWS Glue Data Catalog.

Data Lake 101

Data Lake Sales Data Warehouse Snapshot 101

TDAN

NOVEMBER 5, 2019

There is … but one … Data Governance. Maybe you are one of those that believe that there is something called Master Data Governance, Information Governance, Metadata Governance, Big Data Governance, Customer [or insert domain name here] Data Governance, Data Governance 1.0 – 2.0 – 3.0, […].

Data Governance 69

Data Governance Metadata Big Data Data Strategy 69

Octopai

JANUARY 31, 2021

The particular episode we recommend looks at how WeWork struggled with understanding their data lineage so they created a metadata repository to increase visibility. Agile Data. Another podcast we think is worth a listen is Agile Data. Techcopedia follows the latest trends in data and provides comprehensive tutorials.

Data Governance 57

Data Governance Data Processing Data Quality Metadata 57

CIO Business Intelligence

MARCH 29, 2022

. • You have data but don’t use it. Why does valuable data so often go unused? Lack of annotation with the right metadata is a contributing factor. Another is poor communication between projects or business units. An even larger issue is that people may not know how to see value in data. Reducing data waste.

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Data Quality 52

Domino Data Lab

APRIL 3, 2019

Data governance shows up as the fourth-most-popular kind of solution that enterprise teams were adopting or evaluating during 2019. That’s a lot of priorities – especially when you group together closely related items such as data lineage and metadata management which rank nearby. Validates products for conformance.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

APRIL 18, 2023

Something has been bothering me about data products. It’s the point at which the consumer of a data product immediately switches to also be a producer. We talk a lot about the binary roles of either consumer or producer when in reality the vast majority of people are both at the same time. I know […]

IT 52

IT Metadata Data Governance Data Strategy 52

TDAN

APRIL 19, 2022

Introduction We are living in the age of a data revolution, and more corporations are realizing that to lead—or in some cases, to survive—they need to harness their data wealth effectively.

Data Warehouse 72

Data Warehouse Enterprise IT Metadata 72

TDAN

MAY 19, 2020

If your organization uses data—and even if it doesn’t—you have a data culture. Think about the ways that you and your colleagues interact with and discuss data. Is it spoken about as a driver of business and competitive edge or just the exhaust of your existing […]. Are people afraid of it? Do they trust it?

Interactive 105

Interactive IT Metadata Data Strategy 105

Alation

OCTOBER 21, 2021

Data lakes also support the growing thirst for analysis by data scientists and data analysts, as well as the critical role of data governance. But setting up a data lake takes a thoughtful approach to ensure it’s positioned to prevent it from becoming a data swamp. Lack of metadata.

Data Lake 52

Data Lake Metadata Data Warehouse Data Governance 52

TDAN

DECEMBER 15, 2020

Weinberg’s Second Law: If builders built buildings the way programmers wrote programs, then the first woodpecker that came along would destroy civilization.[1] 1] Introduction Opportunity While most people don’t think about it very often, common language is essential to day-in, day-out commerce.

Data Quality 83

Data Quality IT Metadata Data Strategy 83

TDAN

JANUARY 14, 2020

Recording requirements for success is an important first step toward demonstrating the value of a Data Governance program. Practitioners know that Data Governance requires planning, resources, money and time and that several of these objects are in short supply.

Data Governance 89

Data Governance Metadata Data Strategy Business Intelligence 89

TDAN

MARCH 31, 2020

yield differing answers, making it more difficult to run the business. Executive Summary It seems obvious enough that companies, government agencies and non-profits would benefit from a common language. Without it, coordinating work is more difficult, computers “don’t talk,” and basic questions such as “how many customers do we have?”

IT 84

IT Data Architecture Metadata Data Strategy 84

Jen Stirrup

MARCH 29, 2023

What does a sound, intelligent data foundation give you? It can give business-oriented data strategy for business leaders to help drive better business decisions and ROI. It can also increase productivity by enabling the business to find the data they need when the business teams need it.

Metadata 120

Metadata Data Warehouse Data Integration Business Intelligence 120

TDAN

MARCH 3, 2020

This is surely the case with the “new” products that call themselves data catalogs. But before talking about the rise of the data catalog, I will take […]. If you have been around the IT industry for as long as I have, you have seen technologies and ideas come and go—and sometimes even come back again.

Technology 78

Technology Data Quality IT Metadata 78

TDAN

SEPTEMBER 15, 2020

Remember the Sears catalog? Hundreds of pages of clothes quickly flipped past to get to the toys! Who didn’t spend countless hours trying to find the perfect suggested gift for your next birthday or holiday? In an Amazon and eBay world, thinking about old-school catalogs seems so quaint. Opening a paper volume to manually flip […].

Data Architecture 69

Data Architecture Metadata Data Strategy Data Governance 69

BI-Survey

FEBRUARY 23, 2023

“Data culture eats data strategy for breakfast” has become a popular saying among data and analytics managers and executives. Even the best data strategy cannot fulfill its potential if the data culture in the company does not match it. These include tools for metadata management (e.g.,

Metadata 52

Metadata Data-driven Data Strategy Strategy 52

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

TDAN

APRIL 16, 2019

The secret lies with Data Governance. The Chief Data Officer (or whoever the Data Czar is at your organization) needs to get past, and I mean way past, the “Why is Data Governance important?” or “Why do we need Data Governance?” questions if they are ever going to be successful czar-ing the data.

Data Governance 84

Data Governance Data Quality Metadata Data Strategy 84

TDAN

JANUARY 14, 2020

The stories you hear on the news often mention how this person or that person was battling their demons. Alcoholism, drug addiction, compulsive behaviors like gambling … Demons take many forms. Demons almost never result in good things happening. The word “demon” does not describe something that inspires you to do something good – and […].

Data Quality 64

Data Quality Data Governance Metadata Data Strategy 64

TDAN

APRIL 30, 2019

Roles and responsibilities are the backbone of a successful information or data governance program. To operate an efficient and effective program and hold people formally accountable for doing the “right” thing at the “right” time, it requires the definition and deployment of roles that are appropriate for the culture of the organization.

Data Governance 79

Data Governance Data Quality IT Metadata 79

TDAN

JULY 2, 2019

The third and final part of the Non-Invasive Data Governance Framework details the breakdown of components by level, providing considerations for what must be included at the intersections. The squares are completed with nouns and verbs that provide direction for meaningful discussions about how the program will be set up and operate.

Data Governance 74

Data Governance Data Quality Data Architecture Metadata 74

TDAN

MARCH 17, 2020

Business has a fundamental problem with data quality. In some places it’s merely painful, in others it’s nearly catastrophic. Why is the problem so pervasive? Why does it never seem to get fixed? I believe we’ve been thinking about the problem wrong. It’s time for a fresh look.

Data Quality 59

Data Quality Data Architecture IT Metadata 59

IBM Big Data Hub

MARCH 14, 2024

This involves unifying and sharing a single copy of data and metadata across IBM® watsonx.data ™, IBM® Db2 ®, IBM® Db2® Warehouse and IBM® Netezza ®, using native integrations and supporting open formats, all without the need for migration or recataloging. .

Cost-Benefit 81

Cost-Benefit Metadata Optimization Management 81

TDAN

MARCH 19, 2019

Various databases, plus one or more data warehouses, have been the state-of-the art data management infrastructure in companies for years. The emergence of various new concepts, technologies, and applications such as Hadoop, Tableau, R, Power BI, or Data Lakes indicate that changes are under way.

Management 84

Management Data Lake Data Warehouse Analytics 84

TDAN

MARCH 19, 2019

In our book, Ethical Data and Information Management, Katherine O’Keefe and I look at the relationship between the Ethic of Society, which today finds expression this morning, in a report from a UK Parliamentary Committee setting out their findings against Facebook and Cambridge Analytica. It is a pretty grim reading.

Risk 61

Risk Reporting Management IT 61

TDAN

MAY 14, 2019

To own data or not to own data, that is the question. This question comes up often when I am speaking with clients or groups of people during my Data Governance webinars and conference presentations. To the disgust of some (there are some that choke every time the term “data owner” is used) using the […].

Data Governance 51

Data Governance Data Quality Metadata Data Strategy 51

CIO Business Intelligence

JULY 13, 2022

Data makes the most ambitious and even idealistic goals—like making the world a better place—possible. This is intrinsically worthwhile, but it has now been codified as part of the Federal Data Strategy and its stated mission to “fully leverage the value of federal data for mission, service, and the public good.”

Data-driven 98

Data-driven Metadata Optimization Machine Learning 98

TDAN

JULY 16, 2019

Wouldn’t it be great if you could simply put structure around how your organization governs your data without throwing a lot of money and resources at the problem? It’s all in the data. The truth is you can.

Data Governance 45

Data Governance Management IT Data Quality 45

TDAN

APRIL 2, 2019

Enterprises today are focused on ensuring robust data governance, and are exploring different tools and approaches to support their efforts. Some organizations know exactly what they need, while others can be overwhelmed or confused by all the different solutions out there that claim to support data governance.

Data Governance 45

Data Governance Enterprise Data Quality Metadata 45