David Menninger's Analyst Perspectives

MAY 13, 2021

Everyone talks about data quality, as they should. Our research shows that improving the quality of information is the top benefit of data preparation activities. Data quality efforts are focused on clean data. Yes, clean data is important. but so is bad data.

Data Lake 230

Data Lake Data Quality Data Governance Management 230

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. That means your cloud data assets must be available for use by the right people for the right purposes to maximize their security, quality and value.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

erwin

APRIL 2, 2021

Organizations are managing more data than ever. With more companies increasingly migrating their data to the cloud to ensure availability and scalability, the risks associated with data management and protection also are growing. Data Security Starts with Data Governance.

Data Governance 106

Data Governance Cost-Benefit Risk Metadata 106

Data Virtualization

JUNE 16, 2022

Reading Time: 6 minutes Data Governance as a concept and practice has been around for as long as data management has been around. It, however is gaining prominence and interest in recent years due to the increasing volume of data that needs to be.

Data Governance 98

Data Governance Data Integration Management Data Lake 98

CIO Business Intelligence

NOVEMBER 28, 2023

To avoid the inevitable, CIOs must get serious about data management. Data, of course, has been all the rage the past decade, having been declared the “new oil” of the digital economy. Still, to truly create lasting value with data, organizations must develop data management mastery.

Management 115

Management Data Architecture Data Lake Data Strategy 115

CIO Business Intelligence

APRIL 29, 2022

This would be straightforward task were it not for the fact that, during the digital-era, there has been an explosion of data – collected and stored everywhere – much of it poorly governed, ill-understood, and irrelevant. Further, data management activities don’t end once the AI model has been developed.

Data Governance 145

Data Governance IT Risk Data Lake 145

AWS Big Data

APRIL 24, 2023

Building a data lake on Amazon Simple Storage Service (Amazon S3) provides numerous benefits for an organization. However, many use cases, like performing change data capture (CDC) from an upstream relational database to an Amazon S3-based data lake, require handling data at a record level.

Data Lake 77

Data Lake Data Governance Cost-Benefit Machine Learning 77

erwin

OCTOBER 31, 2019

The Regulatory Rationale for Integrating Data Management & Data Governance. Now, as Cybersecurity Awareness Month comes to a close – and ghosts and goblins roam the streets – we thought it a good time to resurrect some guidance on how data governance can make data security less scary.

Data Governance 105

Data Governance Metadata Risk Data Lake 105

David Menninger's Analyst Perspectives

NOVEMBER 16, 2021

Talend is a data integration and management software company that offers applications for cloud computing, big data integration, application integration, data quality and master data management.

Management 311

Management Data Warehouse Data Quality Data Integration 311

Alation

JANUARY 26, 2023

What’s worse, just 3% of the data in a business enterprise meets quality standards. There’s also no denying that data management is becoming more important, especially to the public. This has spawned new legislation controlling how data can be collected, stored, and utilized, such as the GDPR or CCPA.

Data Governance 52

Data Governance Strategy Data Quality Marketing 52

Jet Global

JULY 2, 2019

To address the flood of data and the needs of enterprise businesses to store, sort, and analyze that data, a new storage solution has evolved: the data lake. What’s in a Data Lake? Data warehouses do a great job of standardizing data from disparate sources for analysis. Taking a Dip.

Data Lake 73

Data Lake Data Warehouse Big Data Machine Learning 73

CIO Business Intelligence

SEPTEMBER 20, 2023

The data can also help us enrich our commodity products. How are you populating your data lake? We’ve decided to take a practical approach, led by Kyle Benning, who runs our data function. Then our analytics team, an IT group, makes sure we build the data lake in the right sequence.

Data Lake 124

Data Lake Data-driven Dashboards Risk 124

CIO Business Intelligence

APRIL 26, 2024

At the core of its strategy is the mountain of data that TransUnion has acquired — along with more than 25 companies — over decades. That data is in the process of being unified on a multilayered platform that offers a variety of data services, including data ingestion, data management, data governance, and data security.

Modeling 100

Modeling IT Machine Learning Data Governance 100

David Menninger's Analyst Perspectives

APRIL 8, 2021

Organizations are accelerating their digital transformation and looking for innovative ways to engage with customers in this new digital era of data management. The challenge is to ensure that processes, applications and data can still be integrated across cloud and on-premises systems.

Management 215

Management Digital Transformation Business Intelligence Internet of Things 215

AWS Big Data

JANUARY 31, 2023

Data governance is the collection of policies, processes, and systems that organizations use to ensure the quality and appropriate handling of their data throughout its lifecycle for the purpose of generating business value.

Data Lake 78

Data Lake Data Governance Data Architecture Machine Learning 78

Data Virtualization

MARCH 7, 2024

Reading Time: 3 minutes As we move deeper into 2024, it is imperative for data management leaders to look in their rear-view mirrors to assess and, if needed, refine their data management strategies. One thing is clear; if data-centric organizations want to succeed in.

Management 59

Management Data Integration Strategy Data Lake 59

David Menninger's Analyst Perspectives

JUNE 12, 2019

Under that focus, Informatica's conference emphasized capabilities across six areas (all strong areas for Informatica): data integration, data management, data quality & governance, Master Data Management (MDM), data cataloging, and data security.

Management 246

Management Data Quality Data Integration Data Lake 246

David Menninger's Analyst Perspectives

SEPTEMBER 22, 2022

But collecting data is only half of the equation. As the data grows, it becomes challenging to find the right data at the right time. Many organizations can’t take full advantage of their data lakes because they don’t know what data actually exists.

Data Lake 266

Data Lake Business Intelligence Analytics IT 266

Data Virtualization

JANUARY 25, 2024

Reading Time: 3 minutes As we head into 2024, it is imperative for data management leaders to look in their rear-view mirrors to assess and, if needed, refine their data management strategies.

Management 59

Management Data Integration Strategy Data Lake 59

AWS Big Data

OCTOBER 20, 2023

Today, we are pleased to announce new AWS Glue connectors for Azure Blob Storage and Azure Data Lake Storage that allow you to move data bi-directionally between Azure Blob Storage, Azure Data Lake Storage, and Amazon Simple Storage Service (Amazon S3). option("header","true").load("wasbs://yourblob@youraccountname.blob.core.windows.net/loadingtest-input/100mb")

Data Lake 80

Data Lake Big Data Consulting Data Warehouse 80

erwin

JANUARY 11, 2019

But the attempts to standardize data across the entire enterprise haven’t produced the desired results. A company can’t effectively implement data governance – documenting and applying business rules and processes, analyzing the impact of changes and conducting audits – if it fails at data management.

Data Governance 40

Data Governance Risk Metadata Management 40

CIO Business Intelligence

MARCH 27, 2024

Le aziende italiane investono in infrastrutture, software e servizi per la gestione e l’analisi dei dati (+18% nel 2023, pari a 2,85 miliardi di euro, secondo l’Osservatorio Big Data & Business Analytics della School of Management del Politecnico di Milano), ma quante sono giunte alla data maturity?

Data Governance 52

Data Governance Data Lake Data Strategy Data-driven 52

AWS Big Data

AUGUST 16, 2023

Iceberg has become very popular for its support for ACID transactions in data lakes and features like schema and partition evolution, time travel, and rollback. AWS Glue crawlers will extract schema information and update the location of Iceberg metadata and schema updates in the Data Catalog. Choose Next. Choose Create.

Data Lake 75

Data Lake Metadata Snapshot Management 75

CIO Business Intelligence

OCTOBER 13, 2023

Data architect role Data architects are senior visionaries who translate business requirements into technology requirements and define data standards and principles, often in support of data or digital transformations. Data architects are frequently part of a data science team and tasked with leading data system projects.

Data Architecture 131

Data Architecture Data Warehouse Statistics Visualization 131

Cloudera

MARCH 5, 2024

This marks a significant milestone for the platform: according to IDC, today about half of the world’s enterprise production data under management is on-prem. The platform is ready to address the complexities of managing highly sensitive, yet critical, company data while still extracting the most value from its use.

Snapshot 86

Snapshot Data Lake Enterprise Data Governance 86

AWS Big Data

MARCH 7, 2023

Decoupled and scalable – Serverless, auto scaled, and fully managed services are preferred over manually managed services. A data hub is a center of data exchange that constitutes a hub of data repositories and is supported by data engineering, data governance, security, and monitoring services.

Analytics 68

Analytics Data Warehouse Data Lake Metadata 68

Cloudera

DECEMBER 11, 2020

As mentioned in my previous blog on the topic , the recent shift to remote working has seen an increase in conversations around how data is managed. Without meeting GxP compliance, the Merck KGaA team could not run the enterprise data lake needed to store, curate, or process the data required to inform business decisions.

Data Lake 98

Data Lake Cost-Benefit Unstructured Data Data Governance 98

Alation

FEBRUARY 13, 2020

In an earlier blog, I defined a data catalog as “a collection of metadata, combined with data management and search tools, that helps analysts and other data users to find the data that they need, serves as an inventory of available data, and provides information to evaluate fitness data for intended uses.”.

Metadata 52

Metadata Management Data Lake Data Governance 52

CIO Business Intelligence

FEBRUARY 16, 2023

My vision is that I can give the keys to my businesses to manage their data and run their data on their own, as opposed to the Data & Tech team being at the center and helping them out,” says Iyengar, director of Data & Tech at Straumann Group North America. The offensive side?

Unstructured Data 105

Unstructured Data Data Lake Prescriptive Analytics Digital Transformation 105

Data Virtualization

FEBRUARY 22, 2023

Reading Time: 2 minutes The data lakehouse attempts to combine the best parts of the data warehouse with the best parts of data lakes while avoiding all of the problems inherent in both. However, the data lakehouse is not the last word in data.

Data Lake 52

Data Lake Data Warehouse Data Integration Management 52

Data Virtualization

FEBRUARY 22, 2023

Reading Time: 2 minutes The data lakehouse attempts to combine the best parts of the data warehouse with the best parts of data lakes while avoiding all of the problems inherent in both. However, the data lakehouse is not the last word in data.

Data Lake 52

Data Lake Data Warehouse Data Integration Management 52

CIO Business Intelligence

MAY 10, 2023

So when you talk about data, there’s a lot of change that can happen from the way people work to how they manage data, and how you report and make decisions based on that data. On data governance: We have 17 different ERP systems, and Novanta is a very acquisitive company, so it’s an ongoing challenge.

Data-driven 105

Data-driven IT Digital Transformation Data Governance 105

Alation

JUNE 14, 2021

And third is what factors CIOs and CISOs should consider when evaluating a catalog – especially one used for data governance. The Role of the CISO in Data Governance and Security. They want CISOs putting in place the data governance needed to actively protect data. So CISOs must protect data.

Data Governance 97

Data Governance Recreation/Entertainment Data Lake Digital Transformation 97

IBM Big Data Hub

JUNE 8, 2022

However, a foundational step in evolving into a data-driven organization requires trusted, readily available, and easily accessible data for users within the organization; thus, an effective data governance program is key. Here are a few common data management challenges: Regulatory compliance on data use.

Data-driven 57

Data-driven Enterprise Data Governance Data Lake 57

Sanjeev Mohan

FEBRUARY 28, 2018

Data Governance is top of mind for most organizations. On one hand, Australians have feverishly opposed numerous attempts to create a national ID yet organizations are looking to link identities across various data sources. It is clear that our mandate as data and analytics professionals is leading us to become data ethicists.

Management 52

Management Internet of Things Data Lake IoT 52

IBM Big Data Hub

JANUARY 5, 2023

The first generation of data architectures represented by enterprise data warehouse and business intelligence platforms were characterized by thousands of ETL jobs, tables, and reports that only a small group of specialized data engineers understood, resulting in an under-realized positive impact on the business.

Data Quality 52

Data Quality Data Architecture Strategy Data Lake 52

Bruno Aziza

NOVEMBER 15, 2017

VEDA — Verizon Enterprise Data Analytics—is an enterprise organization that addresses data management, data governance, data warehousing and data lakes and common analytical and AI technologies.

Big Data 71

Big Data Data Lake Data Governance Enterprise 71