AWS Big Data

APRIL 28, 2023

The first post of this series describes the overall architecture and how Novo Nordisk built a decentralized data mesh architecture, including Amazon Athena as the data query engine. The third post will show how end-users can consume data from their tool of choice, without compromising data governance.

Data Governance 65

Data Governance Management Data-driven Data Lake 65

CIO Business Intelligence

NOVEMBER 28, 2023

Still, to truly create lasting value with data, organizations must develop data management mastery. This means excelling in the under-the-radar disciplines of data architecture and data governance. The knock-on impact of this lack of analyst coverage is a paucity of data about monies being spent on data management.

Management 115

Management Data Architecture Data Lake Data Strategy 115

CIO Business Intelligence

OCTOBER 13, 2023

Solutions data architect: These individuals design and implement data solutions for specific business needs, including data warehouses, data marts, and data lakes. Application data architect: The application data architect designs and implements data models for specific software applications.

Data Architecture 130

Data Architecture Data Warehouse Statistics Visualization 130

AWS Big Data

DECEMBER 21, 2023

To bring their customers the best deals and user experience, smava follows the modern data architecture principles with a data lake as a scalable, durable data store and purpose-built data stores for analytical processing and data consumption.

Data Lake 91

Data Lake Data Warehouse Data-driven B2B 91

BI-Survey

AUGUST 21, 2020

People from BI and analytics teams, business units, IT, corporate management and external consultant teams took part. A time-consuming development process and restricted support of self-service BI are the major drivers for modernizing the data warehouse. Data must become a C-level priority.

Data Warehouse 98

Data Warehouse Data Lake Data Governance Data Architecture 98

Andrew White

DECEMBER 9, 2019

The outline of the call went as follows: I was taking to a central state agency who was organizing a data governance initiative (in their words) across three other state agencies. All four agencies had reported an independent but identical experience with data governance in the past. An expensive consulting engagement.

Analytics 66

Analytics Data Lake Data Governance Metadata 66

CIO Business Intelligence

DECEMBER 21, 2022

By 2025, it’s estimated we’ll have 463 million terabytes of data created every day,” says Lisa Thee, data for good sector lead at Launch Consulting Group in Seattle. But what they really need to do is fundamentally rethink how data is managed and accessed,” he says. We all hear the horror stories,” he says.

IT 130

IT Business Intelligence Sales Key Performance Indicator 130

CDW Research Hub

JULY 22, 2022

The Sirius Data & Analytics Consulting team recently attended Snowflake Summit 2022 in Las Vegas; the first time the annual conference has been held in person since 2019. Whether it was due to being in a room full of data enthusiasts or the magic of Las Vegas, the energy matched the larger attendance and venue.

Data Lake 84

Data Lake Data Governance Consulting Machine Learning 84

BI-Survey

APRIL 27, 2023

Lessons about data modeling, modernization, and automation include the following: Focus on fundamentals Companies place the highest priority on data quality, ease of use, analytics performance, and data governance. The lakehouse, data fabric, and data mesh have 8-12% usage each.

Modeling 52

Modeling Data Warehouse Data Quality Business Driver 52

AWS Big Data

MARCH 27, 2024

They can then use the result of their analysis to understand a patient’s health status, treatment history, and past or upcoming doctor consultations to make more informed decisions, streamline the claim management process, and improve operational outcomes. To get started with this feature, see Querying the AWS Glue Data Catalog.

Data Analytics 93

Data Analytics Analytics Data Warehouse Data Lake 93

Alation

FEBRUARY 13, 2020

Data curation is important in today’s world of data sharing and self-service analytics, but I think it is a frequently misused term. When speaking and consulting, I often hear people refer to data in their data lakes and data warehouses as curated data, believing that it is curated because it is stored as shareable data.

Metadata 52

Metadata Data Warehouse Data Lake Data Governance 52

Alation

APRIL 18, 2023

Top use cases for data profiling Data governance Data governance describes how data should be gathered and used within an organization, impacting data quality, data security, data privacy , and compliance. Do you need to define a data quality rule and add that to the profile?

IT 52

IT Metadata Data Quality Data Governance 52

AWS Big Data

JULY 19, 2023

Conclusion In this post, we showed how to use AWS Glue and the new connector for ingesting data from Google Cloud Storage to Amazon S3. This connector provides access to Google Cloud Storage, facilitating cloud ETL processes for operational reporting, backup and disaster recovery, data governance, and more.

Big Data 85

Big Data Software Consulting Unstructured Data 85

Andrew White

OCTOBER 24, 2019

Here is my update analysis on my 1-1’s and interactions so far: Topic: Data Governance 24. Vision/Data Driven/Outcomes 28. Modern) Master Data Management 16. Data lake 4. Data Literacy 4. Senior Consultant 1. He is not in booth 2!!! AI/Innovation 3. AI/Automation 6. Rolls and Skills 5.

Recreation/Entertainment 49

Recreation/Entertainment Data Lake IT Insurance 49

IBM Big Data Hub

MARCH 14, 2024

This service streamlines data management for AI workloads across hybrid cloud environments and facilitates the scaling of Db2 databases on AWS with minimal effort. Also, IBM Consulting® and AWS have collaborated to help mutual clients to operationalize and derive value from their data for generative AI (gen AI) use cases. 

Cost-Benefit 79

Cost-Benefit Metadata Optimization Management 79

BI-Survey

JANUARY 15, 2023

In general, central data & analytics teams determine the data architecture for analytical data, decoupled from the landscape of operational data sources. Indeed, this is what the data warehouse, data lake and data lakehouse have in common, regardless of the differences in their detail.

Data Warehouse 52

Data Warehouse IT Data Architecture Measurement 52

Andrew White

OCTOBER 25, 2019

Here is my final analysis of my 1-1s and interactions this week: Topic: Data Governance 28. Vision/Data Driven/Outcomes 28. Data, analytics, or D&A Strategy 21. Modern) Master Data Management 18. Data lake 4. Data Literacy 4. IoT/Streaming data 1. Senior Consultant 1.

Recreation/Entertainment 40

Recreation/Entertainment IT Data Lake Data-driven 40

Alation

NOVEMBER 28, 2022

But refreshing this analysis with the latest data was impossible… unless you were proficient in SQL or Python. We wanted to make it easy for anyone to pull data and self service without the technical know-how of the underlying database or data lake. Sathish and I met in 2004 when we were working for Oracle.

Metadata 52

Metadata Enterprise Cost-Benefit Finance 52

Ontotext

MARCH 8, 2023

Graphs reconcile such data continuously crawled from diverse sources to support interactive queries and provide a graphic representation or model of the elements within supply chain, aiding in pathfinding and the ability to semantically enrich complex machine learning (ML) algorithms and decision making.

Enterprise 52

Enterprise Knowledge Discovery Risk Data-driven 52

AWS Big Data

JULY 28, 2023

Data management and governance Addressing the challenges mentioned requires a combination of technical, operational, and legal measures. Organizations need to develop robust data governance practices, establish clear procedures for handling deletion requests, and maintain ongoing compliance with GDPR regulations.

Snapshot 86

Snapshot Metadata Measurement Data Warehouse 86

Alation

AUGUST 11, 2022

Today, the brightest minds in our industry are targeting the massive proliferation of data volumes and the accompanying but hard-to-find value locked within all that data. ET at Gartner D& Summit in Orlando for our presentation, Alation: Helping Regeneron Power Drug Discoveries with Active Data Governance.

Metadata 52

Metadata Data Warehouse Data Quality Data Lake 52

Peter James Thomas

MAY 3, 2019

As part of my consulting business , I end up thinking about Data Capability Frameworks quite a bit. Sometimes this is when I am assessing current Data Capabilities, sometimes it is when I am thinking about how to transition to future Data Capabilities. Control of Data to ensure it is Fit-for-Purpose. Introduction.

Strategy 55

Strategy Data Architecture Data Quality Data Strategy 55

Domino Data Lab

AUGUST 8, 2019

In this episode I’ll cover themes from Sci Foo and important takeaways that data science teams should be tracking. First and foremost: there’s substantial overlap between what the scientific community is working toward for scholarly infrastructure and some of the current needs of data governance in industry. We did it again.”.

Data Science 71

Data Science Machine Learning Data Governance Statistics 71

Andrew White

JANUARY 11, 2021

As with any good consulting response, “it depends.” Do you recommend a consulting approach strategy rather than a CDO strategy? Does Data warehouse as a software tool will play role in future of Data & Analytics strategy? Data lakes don’t offer this nor should they. It really does. Do you agree?

Data Analytics 52

Data Analytics Analytics Data-driven Finance 52

Peter James Thomas

AUGUST 29, 2018

I have since run and driven transformation in Reference Data, Master Data , KYC [3] , Customer Data, Data Warehousing and more recently Data Lakes and Analytics , constantly building experience and capability in the Data Governance , Quality and data services domains, both inside banks, as a consultant and as a vendor.

Data-driven 61

Data-driven Cost-Benefit Metadata Technology 61