AWS Big Data

OCTOBER 3, 2023

Over the years, data lakes on Amazon Simple Storage Service (Amazon S3) have become the default repository for enterprise data and are a common choice for a large set of users who query data for a variety of analytics and machine leaning use cases. Analytics use cases on data lakes are always evolving.

Data Lake 98

Data Lake Metadata Snapshot Recreation/Entertainment 98

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 98

Strategy Data Architecture Cost-Benefit Reporting 98

erwin

JANUARY 9, 2020

That’s because it’s the best way to visualize metadata , and metadata is now the heart of enterprise data management and data governance/ intelligence efforts. So here’s why data modeling is so critical to data governance. erwin Data Modeler: Where the Magic Happens.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

CIO Business Intelligence

MARCH 24, 2023

The program must introduce and support standardization of enterprise data. Programs must support proactive and reactive change management activities for reference data values and the structure/use of master data and metadata.

Data Governance 142

Data Governance Management Metadata Data Quality 142

AWS Big Data

APRIL 26, 2023

Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more. This is a guest blog post co-written with Corey Johnson from Huron.

Metadata 52

Metadata Dashboards Visualization Consulting 52

CIO Business Intelligence

JUNE 23, 2022

Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow.

IT 97

IT Data Architecture Unstructured Data Big Data 97

Octopai

JUNE 15, 2020

Business intelligence databases are dynamic repositories that must often be adjusted based on organizational and or regulatory requirements. With the insurance company’s current data architecture, the process would have no chance of being completed in time for the change. How can BI teams reduce this laborious process?

Insurance 52

Insurance Metadata Business Intelligence Data Warehouse 52

CIO Business Intelligence

JUNE 23, 2022

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes.

Data Lake 98

Data Lake Data Warehouse Machine Learning Cost-Benefit 98

Cloudera

JUNE 18, 2022

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes.

Data Lake 89

Data Lake Data Warehouse Machine Learning Cost-Benefit 89

AWS Big Data

MARCH 10, 2023

However, as data processing at scale solutions grow, organizations need to build more and more features on top of their data lakes. Apache Iceberg overview Iceberg is an open-source table format that brings the power of SQL tables to big data files. The Iceberg table is synced with the AWS Glue Data Catalog.

Data Lake 98

Data Lake Sales Data Warehouse Snapshot 98

Cloudera

AUGUST 30, 2022

Modern data architectures. To eliminate or integrate these silos, the public sector needs to adopt robust data management solutions that support modern data architectures (MDAs). Deploying modern data architectures. Lack of sharing hinders the elimination of fraud, waste, and abuse. Forrester ).

Data Architecture 75

Data Architecture Data Lake Metadata Data Warehouse 75

Peter James Thomas

AUGUST 18, 2018

Even back then, these were used for activities such as Analytics , Dashboards , Statistical Modelling , Data Mining and Advanced Visualisation. Of course some architectures featured both paradigms as well. This required additional investments in metadata.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

CIO Business Intelligence

MARCH 6, 2024

The company is expanding its partnership with Collibra to integrate Collibra’s AI Governance platform with SAP data assets to facilitate data governance for non-SAP data assets in customer environments. “We We are also seeing customers bringing in other data assets from other apps or data sources.

Unstructured Data 129

Unstructured Data Dashboards Business Intelligence Data Governance 129

AWS Big Data

AUGUST 31, 2023

Amazon Redshift is a fast, fully managed petabyte-scale cloud data warehouse that makes it simple and cost-effective to analyze all your data using standard SQL and your existing business intelligence (BI) tools. Iceberg stores the metadata pointer for all the metadata files.

Data Lake 89

Data Lake Data Warehouse Metadata Data Architecture 89

AWS Big Data

SEPTEMBER 7, 2023

AWS Glue Data Catalog stores information as metadata tables, where each table specifies a single data store. The AWS Glue crawler writes metadata to the Data Catalog by classifying the data to determine the format, schema, and associated properties of the data.

Metadata 95

Metadata Dashboards Metrics Visualization 95

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

Cloudera

JUNE 30, 2022

With Cloudera’s vision of hybrid data , enterprises adopting an open data lakehouse can easily get application interoperability and portability to and from on premises environments and any public cloud without worrying about data scaling. Why integrate Apache Iceberg with Cloudera Data Platform?

Data Lake 83

Data Lake Data Architecture Metadata Data Warehouse 83

DataKitchen

OCTOBER 11, 2021

First, you must understand the existing challenges of the data team, including the data architecture and end-to-end toolchain. Monitoring Job Metadata. Monitoring and tracking is an essential feature that many data teams are looking to add to their pipelines. Second, you must establish a definition of “done.”

Testing 157

Testing Metadata Dashboards Statistics 157

AWS Big Data

JANUARY 22, 2024

The majority of data produced by these accounts is used downstream for business intelligence (BI) purposes and in Amazon Athena , by hundreds of business users every day. The solution Acast implemented is a data mesh, architected on AWS.

Data-driven 82

Data-driven Advertising Metadata Data Architecture 82

Alation

APRIL 14, 2022

In today’s AI/ML-driven world of data analytics, explainability needs a repository just as much as those doing the explaining need access to metadata, EG, information about the data being used. The Cloud Data Migration Challenge. On-premises business intelligence and databases. Cloud governance.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

IBM Big Data Hub

JANUARY 18, 2023

Data platform architecture has an interesting history. Towards the turn of millennium, enterprises started to realize that the reporting and business intelligence workload required a new solution rather than the transactional applications. Data fabric promotes data discoverability. It was Datawarehouse.

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

TDAN

MAY 31, 2022

As we enter a new cloud-first era, advancements in technology have helped companies capture and capitalize on data as much as possible. Deciding between which cloud architecture to use has always been a debate between two options: data warehouses and data lakes.

Data Lake 52

Data Lake Data Warehouse Technology Data Architecture 52

TDAN

MARCH 31, 2020

yield differing answers, making it more difficult to run the business. Executive Summary It seems obvious enough that companies, government agencies and non-profits would benefit from a common language. Without it, coordinating work is more difficult, computers “don’t talk,” and basic questions such as “how many customers do we have?”

IT 84

IT Data Architecture Metadata Data Strategy 84

TDAN

MAY 3, 2022

The road to creating business value through a well-oiled data management strategy can be long and challenging. A successful data management strategy is one that generates value rapidly and unlocks new data-driven insights.

Analytics 52

Analytics Data-driven Strategy Management 52

Jen Stirrup

MARCH 29, 2023

SAP Datasphere helps eliminate hidden data debt within organizations, enabling customers to build a business data fabric architecture that quickly delivers meaningful data with business context and logic intact. Business Intelligence is often a search problem in disguise.

Metadata 120

Metadata Data Warehouse Data Integration Business Intelligence 120

Octopai

APRIL 8, 2020

While there are many factors that led to this event, one critical dynamic was the inadequacy of the data architectures supporting banks and their risk management systems. Let’s examine how these processes failed, what regulations were put in place as a result, and what this means for business intelligence teams today.

Finance 52

Finance Cost-Benefit Metadata Data Architecture 52

TDAN

SEPTEMBER 15, 2020

Remember the Sears catalog? Hundreds of pages of clothes quickly flipped past to get to the toys! Who didn’t spend countless hours trying to find the perfect suggested gift for your next birthday or holiday? In an Amazon and eBay world, thinking about old-school catalogs seems so quaint. Opening a paper volume to manually flip […].

Data Architecture 69

Data Architecture Metadata Data Strategy Data Governance 69

IBM Big Data Hub

JULY 13, 2023

The more complete, accurate and consistent a dataset is, the more informed business intelligence and business processes become. Geocoding Geocoding is the process of adding location metadata to an organization’s datasets. Learn more about designing the right data architecture to elevate your data quality here.

Data Quality 71

Data Quality Data Integration Metadata Cost-Benefit 71

Sisense

JULY 6, 2020

First off, this involves defining workflows for every business process within the enterprise: the what, how, why, who, when, and where aspects of data. These regulations, ultimately, ensure key business values: data consistency, quality, and trustworthiness. Benefits of enterprise data management.

Enterprise 98

Enterprise Management Data Architecture Strategy 98

TDAN

AUGUST 3, 2021

Edge Computing Types As more and more devices are introduced into networks, the volume of data being transmitted at any point in time has risen exponentially.

Data Architecture 52

Data Architecture Metadata Business Intelligence Big Data 52

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

Data Virtualization

MARCH 3, 2021

Data is the fuel of the digital economy, so data-centric organizations have a distinct advantage. To remain competitive, organizations must have a data management strategy in place to effectively ingest, store, organize, and analyze data while ensuring that it is.

Enterprise 75

Enterprise Management Strategy Data Lake 75

CIO Business Intelligence

MARCH 9, 2022

They conveniently store data in a flat architecture that can be queried in aggregate and offer the speed and lower cost required for big data analytics. On the other hand, they don’t support transactions or enforce data quality. If only there were a best-of-both-worlds compromise. .

Data Lake 119

Data Lake Unstructured Data Data Warehouse Data Quality 119

TDAN

JULY 2, 2019

The third and final part of the Non-Invasive Data Governance Framework details the breakdown of components by level, providing considerations for what must be included at the intersections. The squares are completed with nouns and verbs that provide direction for meaningful discussions about how the program will be set up and operate.

Data Governance 74

Data Governance Data Quality Data Architecture Metadata 74

TDAN

MARCH 17, 2020

Business has a fundamental problem with data quality. In some places it’s merely painful, in others it’s nearly catastrophic. Why is the problem so pervasive? Why does it never seem to get fixed? I believe we’ve been thinking about the problem wrong. It’s time for a fresh look.

Data Quality 59

Data Quality Data Architecture IT Metadata 59

AWS Big Data

NOVEMBER 29, 2023

In 2013, Amazon Web Services revolutionized the data warehousing industry by launching Amazon Redshift , the first fully-managed, petabyte-scale, enterprise-grade cloud data warehouse. Amazon Redshift made it simple and cost-effective to efficiently analyze large volumes of data using existing business intelligence tools.

Data Warehouse 97

Data Warehouse Data Lake Analytics Machine Learning 97

TDAN

JUNE 30, 2020

About a week ago, I was teaching a data modeling class, and an attendee asked me to explain the concept of a data catalog. However, I had recently read the book, The Data Catalog: Sherlock Holmes Data Sleuthing for Analytics by […]. Like a lot of hype-related terms in IT, there is more than one definition.

Modeling 52

Modeling Analytics Data Architecture IT 52