erwin

JANUARY 17, 2020

Data modeling is a process that enables organizations to discover, design, visualize, standardize and deploy high-quality data assets through an intuitive, graphical interface. Data models provide visualization, create additional metadata and standardize data design across the enterprise. SQL or NoSQL?

Data-driven 138

Data-driven Modeling Metadata Data Governance 138

TDAN

APRIL 6, 2021

There is an ever-increasing awareness of concerns about data privacy, corporate data breaches, increasing demands for regulatory compliance. There are also emerging concerns about the ways that big data analytics potentially influence and bias automated decision-making.

Risk Management 64

Risk Management Risk Management Big Data 64

CIO Business Intelligence

DECEMBER 16, 2022

An average premium of 12% was on offer for PMI Program Management Professional (PgMP), up 20%, and for GIAC Certified Forensics Analyst (GCFA), InfoSys Security Engineering Professional (ISSEP/CISSP), and Okta Certified Developer, all up 9.1% Despite this, average pay premiums for management, methodology and process skills rose 2.3%

Testing 83

Testing Metadata Data Processing Machine Learning 83

CIO Business Intelligence

JUNE 23, 2022

The cause is hybrid data – the massive amounts of data created everywhere businesses operate – in clouds, on-prem, and at the edge. Only a fraction of data created is actually stored and managed, with analysts estimating it to be between 4 – 6 ZB in 2020. Big data is cool again.

IT 73

IT Data Architecture Unstructured Data Big Data 73

AWS Big Data

MARCH 10, 2023

Since the deluge of big data over a decade ago, many organizations have learned to build applications to process and analyze petabytes of data. Data lakes have served as a central repository to store structured and unstructured data at any scale and in various formats.

Data Lake 102

Data Lake Sales Data Warehouse Snapshot 102

AWS Big Data

APRIL 26, 2023

Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more. Enables a hub-and-spoke model for Data Access in multiple AWS accounts in a data mesh fashion.

Metadata 52

Metadata Dashboards Visualization Consulting 52

CIO Business Intelligence

MARCH 21, 2022

A data scientist’s approach to data analysis depends on their industry and the specific needs of the business or department they are working for. Before a data scientist can find meaning in structured or unstructured data, business leaders and department managers must communicate what they’re looking for.

Unstructured Data 130

Unstructured Data Data Analytics Analytics Structured Data 130

TDAN

MARCH 19, 2019

Various databases, plus one or more data warehouses, have been the state-of-the art data management infrastructure in companies for years. The emergence of various new concepts, technologies, and applications such as Hadoop, Tableau, R, Power BI, or Data Lakes indicate that changes are under way.

Management 84

Management Data Lake Data Warehouse Analytics 84

TDAN

NOVEMBER 5, 2019

Maybe you are one of those that believe that there is something called Master Data Governance, Information Governance, Metadata Governance, Big Data Governance, Customer [or insert domain name here] Data Governance, Data Governance 1.0 – 2.0 – 3.0, […].

Data Governance 69

Data Governance Metadata Big Data Data Strategy 69

AWS Big Data

MAY 4, 2023

Data scientists have access to the Jupyter notebook hosted on SageMaker. The OpenSearch Service domain stores metadata on the datasets connected at the Regions. Notebook users can query this service to retrieve details such as the correct Region of Dask workers without needing to know the data’s Regional location beforehand.

Data Processing 94

Data Processing Metadata Informatics Interactive 94

AWS Big Data

JANUARY 31, 2023

Data governance is increasingly top-of-mind for customers as they recognize data as one of their most important assets. Effective data governance enables better decision-making by improving data quality, reducing data management costs, and ensuring secure access to data for stakeholders.

Data Lake 82

Data Lake Data Governance Data Architecture Data Warehouse 82

AWS Big Data

APRIL 3, 2024

If the asset has AWS Glue Data Quality enabled, you can now quickly visualize the data quality score directly in the catalog search pane. By selecting the corresponding asset, you can understand its content through the readme, glossary terms , and technical and business metadata.

Data Quality 89

Data Quality Visualization Metadata Metrics 89

Alation

OCTOBER 5, 2021

Yet, so many companies today are still failing miserably in implementing data strategy and governance protocols. Why is your data governance strategy failing? Perhaps even more alarming: fewer than 33% expect to exceed their returns on investment for data analytics within the next two years. Incomplete data.

Data Governance 96

Data Governance Strategy Data Quality Metrics 96

IBM Big Data Hub

JUNE 8, 2022

Implementing the right data strategy spurs innovation and outstanding business outcomes by recognizing data as a critical asset that provides insights for better and more informed decision-making. Here are a few common data management challenges: Regulatory compliance on data use.

Data-driven 56

Data-driven Enterprise Data Governance Data Lake 56

AWS Big Data

APRIL 19, 2023

Data mesh is a new approach to data management. Companies across industries are using a data mesh to decentralize data management to improve data agility and get value from data. A modern data architecture is critical in order to become a data-driven organization.

Technology 82

Technology Data-driven Machine Learning Sales 82

Octopai

JANUARY 31, 2021

We have identified the top ten sites, videos, or podcasts online that deal with data lineage. Our list of Top 10 Data Lineage Podcasts, Blogs, and Websites To Follow in 2021. Data Engineering Podcast. This podcast centers around data management and investigates a different aspect of this field each week.

Data Governance 57

Data Governance Data Processing Data Quality Metadata 57

Domino Data Lab

APRIL 3, 2019

It includes perspectives about current issues, themes, vendors, and products for data governance. My interest in data governance (DG) began with the recent industry surveys by O’Reilly Media about enterprise adoption of “ABC” (AI, Big Data, Cloud). Taken together, those points warranted a much deeper review of the field.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

Sisense

MAY 28, 2020

During our current pandemic, access to real-time data can also save lives. Health officials are investigating how contact-tracing apps can help manage the ‘reopening’ after we begin to reopen the country after the COVID-19 lockdown,” said George Thiruvathukal, professor of computer science at Loyola University in Chicago.

Internet of Things 83

Internet of Things Metadata Data-driven Unstructured Data 83

TDAN

JUNE 6, 2023

You would think that after knocking around in semantics and knowledge graphs for over two decades I’d have had a pretty good idea about Knowledge Management, but it turns out I didn’t. I think in the rare event the term came up I internally conflated it with Knowledge Graphs and moved on. The first tap […]

Management 97

Management IT Data Architecture Metadata 97

AWS Big Data

OCTOBER 25, 2023

Additionally, we show how to use AWS AI/ML services for analyzing unstructured data. Why it’s challenging to process and manage unstructured data Unstructured data makes up a large proportion of the data in the enterprise that can’t be stored in a traditional relational database management systems (RDBMS).

Unstructured Data 119

Unstructured Data Metadata Management Analytics 119

AWS Big Data

MARCH 26, 2024

A Gartner Marketing survey found only 14% of organizations have successfully implemented a C360 solution, due to lack of consensus on what a 360-degree view means, challenges with data quality, and lack of cross-functional governance structure for customer data.

Data Strategy 68

Data Strategy Strategy Data Warehouse Prescriptive Analytics 68

AWS Big Data

SEPTEMBER 13, 2023

Operational data processing framework The operational data processing (ODP) framework contains three components: File Manager, File Processor, and Configuration Manager. Each component runs independently to solve a portion of the operational data processing use case.

Data Lake 91

Data Lake Data Processing Metadata Snapshot 91

IBM Big Data Hub

OCTOBER 4, 2023

Artificial intelligence (AI) is now at the forefront of how enterprises work with data to help reinvent operations, improve customer experiences, and maintain a competitive advantage. It’s no longer a nice-to-have, but an integral part of a successful data strategy. How does an open data lakehouse architecture support AI?

Data Lake 78

Data Lake Metadata Cost-Benefit Data Warehouse 78

AWS Big Data

JULY 28, 2023

Organizations must comply with these requests provided that there are no legitimate grounds for retaining the personal data, such as legal obligations or contractual requirements. Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. Tags provide metadata about resources at a glance.

Snapshot 83

Snapshot Metadata Measurement Data Warehouse 83

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

MAY 14, 2019

The President’s Management Agenda (PMA) lays out a long-term vision for modernizing the Federal Government. Cross-Agency Priority (CAP) Goal #2 is “leverage data as a strategic asset to grow the economy, increase the effectiveness of the Federal Government, facilitate oversight, and promote transparency.”

Management 40

Management Data Quality Data Architecture Metadata 40

AWS Big Data

FEBRUARY 1, 2023

We also used AWS Lambda for data processing. To further optimize and improve the developer velocity for our data consumers, we added Amazon DynamoDB as a metadata store for different data sources landing in the data lake. Clients access this data store with an API’s.

Optimization 52

Optimization Forecasting Data Lake Metadata 52

TDAN

MAY 31, 2022

The Titanic set sail on its maiden voyage on April 10, 1912. Four days later on April 14th, the ship collides with a submerged iceberg and sinks in less than three hours. The captain and his crew had insufficient knowledge of the danger that lurked beneath the sea. This lack of awareness led to the […].

IT 59

IT Metadata Data Strategy Data Governance 59

TDAN

SEPTEMBER 15, 2020

In the world of data, automation plays a well-honed role in rapidly developing modern data estates. Before we proceed any further, let’s establish an understanding about the purpose of a corporate data estate. A data estate is the technical architecture and enterprise infrastructure that enables organizations to […].

Enterprise 85

Enterprise Data Architecture Metadata Data Strategy 85

TDAN

MAY 31, 2022

One very influential factor that can potentially undermine your data and document strategies is the natural and emotional reactions of people when things change. It is common to take great care in the selection and implementation of new technology.

Testing 52

Testing Interactive Strategy Software 52

Alation

MARCH 21, 2023

Today, modern travel and tourism thrive on data. For example, airlines have historically applied analytics to revenue management, while successful hospitality leaders make data-driven decisions around property allocation and workforce management. What is big data in the travel and tourism industry?

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

TDAN

JANUARY 5, 2021

A recent report on data culture released by Alation shows that enterprises continue to make progress toward creating a data culture even while the pandemic has forced them to make tough decisions. More than half of data professionals believe […]. But things are looking up.

Reporting 52

Reporting Enterprise Metadata Data Strategy 52

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

CIO Business Intelligence

JULY 13, 2022

Much of the hype around big data and analytics focuses on business value and bottom-line impacts. Data makes the most ambitious and even idealistic goals—like making the world a better place—possible. Data makes the most ambitious and even idealistic goals—like making the world a better place—possible.

Data-driven 78

Data-driven Metadata Optimization Machine Learning 78

Cloudera

JUNE 24, 2022

Much of the hype around big data and analytics focuses on business value and bottom-line impacts. Data makes the most ambitious and even idealistic goals —like making the world a better place — possible. Data makes the most ambitious and even idealistic goals —like making the world a better place — possible.

Data-driven 76

Data-driven Metadata Optimization Machine Learning 76

IBM Big Data Hub

MARCH 14, 2024

Businesses face significant hurdles when preparing data for artificial intelligence (AI) applications. The existence of data silos and duplication, alongside apprehensions regarding data quality, presents a multifaceted environment for organizations to manage.

Cost-Benefit 76

Cost-Benefit Metadata Optimization Management 76

TDAN

FEBRUARY 4, 2020

Back in 2017, I wrote an article titled There are No Facts … Without Data. It is time to revisit that topic. The overwhelmingly positive response to that article validated for me that most people believed my premise to be true. I was very thankful to see that. In this anti-fact world (watch cable news […].

Data Quality 59

Data Quality IT Data Governance Metadata 59