AWS Big Data

FEBRUARY 12, 2024

Public health organizations need access to data insights that they can quickly act upon, especially in times of health emergencies, when data needs to be updated multiple times daily. Instead, they rely on up-to-date dashboards that help them visualize data insights to make informed decisions quickly.

Publishing 89

Publishing Dashboards Metadata Visualization 89

erwin

NOVEMBER 21, 2019

In the era of data-driven business, such perspective is critical. White Paper – Data-Driven Business Transformation: Using data as a strategic asset and transformational tool to succeed in the digital age. Related blog: The Key to Improving Business and IT Alignment. Retain organizational knowledge.

Enterprise 77

Enterprise Data-driven Data Governance Digital Transformation 77

erwin

JUNE 19, 2020

Much like the differences between enterprise architecture (EA) and data architecture, EA’s holistic view of the enterprise will often see enterprise and solution architects collaborate. And as with data architecture , a solution architect’s focus is narrower. In this post: What Is a Solutions Architect?

Enterprise 130

Enterprise Data Architecture Strategy Data Governance 130

erwin

NOVEMBER 21, 2019

In the era of data-driven business, such perspective is critical. Data-Driven Business Transformation: Using data as a transformational tool to succeed in the digital age. Data-Driven Business Transformation: Using data as a transformational tool to succeed in the digital age.

Enterprise 72

Enterprise Data-driven Data Governance Digital Transformation 72

AWS Big Data

OCTOBER 20, 2023

Today, we are pleased to announce new AWS Glue connectors for Azure Blob Storage and Azure Data Lake Storage that allow you to move data bi-directionally between Azure Blob Storage, Azure Data Lake Storage, and Amazon Simple Storage Service (Amazon S3).

Data Lake 82

Data Lake Big Data Consulting Data Warehouse 82

erwin

FEBRUARY 13, 2020

When an organization’s data governance and metadata management programs work in harmony, then everything is easier. Data governance is a complex but critical practice. Data Governance Attitudes Are Shifting. Metadata Management Takes Time.

Metadata 135

Metadata Data Governance Management Cost-Benefit 135

AWS Big Data

OCTOBER 10, 2023

Data governance is the process of ensuring the integrity, availability, usability, and security of an organization’s data. Due to the volume, velocity, and variety of data being ingested in data lakes, it can get challenging to develop and maintain policies and procedures to ensure data governance at scale for your data lake.

Data Quality 89

Data Quality Data Governance Data Lake Testing 89

AWS Big Data

JULY 19, 2023

Today, we are pleased to announce a new AWS Glue connector for Google Cloud Storage that allows you to move data bi-directionally between Google Cloud Storage and Amazon Simple Storage Service (Amazon S3). With this connector, you can bring the data from Google Cloud Storage to Amazon S3.

Big Data 81

Big Data Software Consulting Unstructured Data 81

erwin

JANUARY 9, 2020

Enterprises are trying to manage data chaos. They also face increasing regulatory pressure because of global data regulations , such as the European Union’s General Data Protection Regulation (GDPR) and the new California Consumer Privacy Act (CCPA), that went into effect last week on Jan. GDPR: Key Differences.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

Alation

JUNE 14, 2021

The Role of Catalog in Data Security. Recently, I dug in with CIOs on the topic of data security. Recently, I dug in with CIOs on the topic of data security. What came as no surprise was the importance CIOs place on taking a broader approach to data protection. The Role of the CISO in Data Governance and Security.

Data Governance 97

Data Governance Recreation/Entertainment Data Lake Digital Transformation 97

AWS Big Data

JANUARY 30, 2023

Many customers need an ACID transaction (atomic, consistent, isolated, durable) data lake that can log change data capture (CDC) from operational data sources. There is also demand for merging real-time data into batch data. The Delta Lake layer ensures ACID compliance of the source data.

Insurance 77

Insurance Data Lake Data-driven Management 77

AWS Big Data

JUNE 29, 2023

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud that delivers powerful and secure insights on all your data with the best price-performance. With Amazon Redshift, you can analyze your data to derive holistic insights about your business and your customers.

Data Warehouse 59

Data Warehouse Dashboards Testing Visualization 59

erwin

JUNE 19, 2020

Much like the differences between enterprise architecture (EA) and data architecture, EA’s holistic view of the enterprise will often see enterprise and solution architects collaborate. And as with data architecture , a solution architect’s focus is narrower. In this post: What Is a Solutions Architect?

Enterprise 94

Enterprise Data Architecture Strategy Data Governance 94

erwin

MAY 2, 2019

Enterprise architect is a common job title within IT organizations at large companies, but the term lacks any standard definition. Ask someone on the business side what their organization’s enterprise architects do, and you’ll likely get a response like, “They work with IT,” which is true, but also pretty vague.

Enterprise 95

Enterprise Digital Transformation Consulting Modeling 95

erwin

JUNE 22, 2020

It describes an unfortunate reality for many data stewards, who spend 80 percent of their time finding, cleaning and reorganizing huge amounts of data, and only 20 percent of their time on actual data analysis. Earlier this year, erwin released its 2020 State of Data Governance and Automation (DGA) report.

Metadata 105

Metadata Data Governance Digital Transformation Measurement 105

CDW Research Hub

JULY 18, 2022

While many organizations understand the business need for a data and analytics cloud platform , few can quickly modernize their legacy data warehouse due to a lack of skills, resources, and data literacy. One modern data platform solution that provides simplicity and flexibility to grow is Snowflake’s data cloud and platform.

Optimization 87

Optimization Data Lake Data Warehouse Manufacturing 87

erwin

JULY 26, 2019

Part three of erwin’s digital transformation blog series. . Automated data collection and connection is costly and error-prone. Automated data collection and connection is costly and error-prone. Lack of true asset governance and collaboration. Enterprise architecture (EA) isn’t dead, you’re just using it wrong.

Digital Transformation 106

Digital Transformation Strategy Enterprise Business Intelligence 106

Domino Data Lab

JULY 19, 2021

One of the primary challenges of any ML/AI project is transitioning it from the hands of data scientists in the develop phase of the data science lifecycle into the hands of engineers in the deploy phase. Where in the life cycle does data scientists’ involvement end? They may rely on, or be assisted by, the data analysts.

Enterprise 85

Enterprise Data Science Testing Modeling 85

AWS Big Data

APRIL 24, 2023

Building a data lake on Amazon Simple Storage Service (Amazon S3) provides numerous benefits for an organization. However, many use cases, like performing change data capture (CDC) from an upstream relational database to an Amazon S3-based data lake, require handling data at a record level.

Data Lake 79

Data Lake Data Governance Cost-Benefit Machine Learning 79

AWS Big Data

MARCH 23, 2023

We recently announced support for AWS Lake Formation fine-grained access control policies in Amazon Athena queries for data stored in any supported file format using table formats such as Apache Iceberg, Apache Hudi and Apache Hive. Lake Formation provides an authorization and governance layer on data stored in Amazon S3.

Interactive 67

Interactive Snapshot Data Lake Software 67

Cloudera

FEBRUARY 16, 2021

In the previous blog post , we looked at some of the application development concepts for the Cloudera Operational Database (COD). In this blog post, we’ll see how you can use other CDP services with COD. Integrated across the Enterprise Data Lifecycle . Cloudera Data Engineering to ingest bulk data and data from mainframes.

Machine Learning 83

Machine Learning Data Lake Enterprise Data Warehouse 83

Andrew White

OCTOBER 22, 2021

If you follow my blog for any period of time you will know that for most years I have attended our annual Gartner IT Symposium I do a day-in-the-life blog of an analyst. MDM and/or D&A Governance and Stewardship 26. Monetization/Link data to outcome (value pyramid) business value of data/business impact 20.

IT 52

IT Data Lake Strategy Data Science 52

IBM Big Data Hub

JULY 5, 2022

In today’s world of complex data architectures and emerging technologies, databases can sometimes be undervalued and unrecognized. IBM has been the pioneer in paving the way for data management technologies and advancements for decades, from the first commercial database to quantum computing systems. This is the story of Db2. .

Data Lake 93

Data Lake Data Warehouse Publishing Structured Data 93

Andrew White

OCTOBER 22, 2020

Topics : (broader/full) Data and Analytics Strategy 14. Data and Analytics Governance and/or MDM 10. Organization, Leadership, Roles etc. Data Management 3. Data Monetization 1. Role/Title (31): Business development manager 1. Role/Title (31): Business development manager 1. Data Governance 1.

IT 52

IT Recreation/Entertainment Data Quality Data-driven 52

AWS Big Data

NOVEMBER 22, 2023

Today, we’re making available a new capability of AWS Glue Data Catalog that allows generating column-level statistics for AWS Glue tables. Data lakes are designed for storing vast amounts of raw, unstructured, or semi-structured data at a low cost, and organizations share those datasets across multiple departments and teams.

Statistics 99

Statistics Data Lake Optimization Data-driven 99

Alation

SEPTEMBER 30, 2021

Alation achieves a top-rank for Innovation within the peer group Data Governance Products , according to BARC’s The Data Management Survey 22. Alation was ranked #1 in two KPIs within the Data Governance Products peer group: Innovation and Innovation Power. We use it as a central hub for all things data.

Management 52

Management Data Governance KPI Metadata 52

erwin

MAY 7, 2020

Although there is some crossover, there are stark differences between data architecture and enterprise architecture (EA). That’s because data architecture is actually an offshoot of enterprise architecture. The difference between data architecture and enterprise architecture can be represented with the Zachman Framework.

Data Architecture 131

Data Architecture Enterprise Modeling Sales 131

DataKitchen

SEPTEMBER 20, 2021

Data organizations don’t always have the budget or schedule required for DataOps when conceived as a top-to-bottom, enterprise-wide transformational change. DataOps can and should be implemented in small steps that complement and build upon existing workflows and data pipelines. Figure 1 shows the four phases of Lean DataOps.

Testing 246

Testing Metrics Measurement Dashboards 246

IBM Big Data Hub

JANUARY 5, 2023

Poor data quality is one of the top barriers faced by organizations aspiring to be more data-driven. Ill-timed business decisions and misinformed business processes, missed revenue opportunities, failed business initiatives and complex data systems can all stem from data quality issues.

Data Quality 52

Data Quality Data Architecture Strategy Data Lake 52

AWS Big Data

APRIL 20, 2023

Customers use Amazon Redshift to run their business-critical analytics on petabytes of structured and semi-structured data. Apache Spark enables you to build applications in a variety of languages, such as Java, Scala, and Python, by accessing the data in your Amazon Redshift data warehouse.

Data Lake 76

Data Lake Data Warehouse Sales Data-driven 76

Ontotext

OCTOBER 11, 2023

These delved deep into the transformative potential of Large Language Models (LLMs) and the need for semantic technologies to ensure high-quality training data for these models. His presentation emphasized again the need for quality and standardized data in AI and in projects in general. Are LLMs Knowledgeable?

Metadata 69

Metadata Cost-Benefit Marketing Modeling 69

erwin

APRIL 25, 2019

Data governance is one area where business and IT never seemed to establish ownership. Early attempts at data governance treated the idea as a game of volleyball, passing ownership back and forth, with one team responsible for storing data and running applications, and one responsible for using the data for business outcomes.

Enterprise 94

Enterprise Digital Transformation Data Governance Business Intelligence 94

Cloudera

SEPTEMBER 28, 2020

Cloudera delivers an enterprise data cloud that enables companies to build end-to-end data pipelines for hybrid cloud, spanning edge devices to public or private cloud, with integrated security and governance underpinning it to protect customers data. Let’s take a look at one customer’s upgrade journey. Background: .

Testing 130

Testing Metadata Risk Data Science 130

CDW Research Hub

SEPTEMBER 9, 2021

A typical enterprise can collect millions of monitoring data points every day. In the early days SIEM solutions were not equipped to handle mainframe data, but that has changed. While there are other SIEM solutions in the marketplace, this blog will focus on Splunk. Generates alerts if suspicious activity is detected.

Strategy 59

Strategy Enterprise Dashboards Software 59

Alation

MARCH 29, 2023

Prior to that, I was a CTO in the state of California and have worked for state and local governments for 15 years. Prior to that, I was a CTO in the state of California and have worked for state and local governments for 15 years. What role do partners play in the process? Please tell us about your background.

Data Strategy 52

Data Strategy Strategy Data Governance Sales 52

Alation

MARCH 1, 2023

How are blockchain organizations tackling data management? To learn the answer, we sat down with Karla Kirton , Data Architect at Blockdaemon, a blockchain company, to discuss data strategy , decentralization, and how implementing Alation has supported them. What are the goals of your data team?

Data Strategy 52

Data Strategy Strategy Metadata Interactive 52

CIO Business Intelligence

APRIL 19, 2022

It has just become very topical due to a changing geopolitical landscape and new regulations that affect control of data. In practice, this is all about data: where does it reside, where is it flowing, and who has control over it? These questions are critical for a modern data economy, where data means power.

Metadata 59

Metadata Risk Data-driven Strategy 59