David Menninger's Analyst Perspectives

NOVEMBER 16, 2021

Talend is a data integration and management software company that offers applications for cloud computing, big data integration, application integration, data quality and master data management.

Management 320

Management Data Warehouse Data Quality Data Integration 320

IBM Big Data Hub

JANUARY 5, 2023

Next generation of big data platforms and long running batch jobs operated by a central team of data engineers have often led to data lake swamps. Meaning, data architecture is a foundational element of your business strategy for higher data quality. Creating a data architecture roadmap.

Data Quality 52

Data Quality Data Architecture Strategy Data Lake 52

AWS Big Data

JANUARY 30, 2023

Many customers need an ACID transaction (atomic, consistent, isolated, durable) data lake that can log change data capture (CDC) from operational data sources. There is also demand for merging real-time data into batch data. Delta Lake framework provides these two capabilities. option("header",True).schema(schema).load("s3://"+

Insurance 80

Insurance Data Lake Data-driven Management 80

CIO Business Intelligence

AUGUST 2, 2023

A data and analytics capability cannot emerge from an IT or business strategy alone. With both technology and business organization deeply involved in the what, why, and how of data, companies need to create cross-functional data teams to get the most out of it.

Manufacturing 94

Manufacturing Data Architecture Strategy Data Strategy 94

IBM Big Data Hub

DECEMBER 16, 2022

For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance. It uses metadata and data management tools to organize all data assets within your organization. This is especially helpful when handling massive amounts of big data.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

Data Virtualization

MARCH 7, 2024

One thing is clear; if data-centric organizations want to succeed in. The post Data Management Predictions for 2024: Five Trends appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Management 59

Management Data Integration Strategy Data Lake 59

Data Virtualization

JANUARY 25, 2024

One thing is clear; if data-centric organizations want to succeed in 2024, The post Data Management Predictions for 2024: Five Trends appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Management 59

Management Data Integration Strategy Data Lake 59

Data Virtualization

OCTOBER 18, 2022

The post The Data Warehouse is Dead, Long Live the Data Warehouse, Part I appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information. In times of potentially troublesome change, the apparent paradox and inner poetry of these.

Data Warehouse 98

Data Warehouse ROI Data Integration Internet of Things 98

AWS Big Data

JULY 19, 2023

AWS Glue is a serverless data integration service that makes it simple to discover, prepare, and combine data for analytics, machine learning, and application development. Conclusion In this post, we showed how to use AWS Glue and the new connector for ingesting data from Google Cloud Storage to Amazon S3.

Big Data 84

Big Data Software Consulting Unstructured Data 84

AWS Big Data

MARCH 27, 2024

Achieving this will also improve general public health through better and more timely interventions, identify health risks through predictive analytics, and accelerate the research and development process. This will be your online transaction processing (OLTP) data store for transactional data.

Data Analytics 92

Data Analytics Analytics Data Warehouse Data Lake 92

Data Virtualization

MARCH 23, 2023

The post 5 Trends in Financial Services That Will Change How You Think about Your Data appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Interactive 52

Interactive Data Integration Technology Management 52

Data Virtualization

MARCH 23, 2023

The post <strong>5 Trends in Financial Services That Will Change How You Think about Your Data</strong> appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Interactive 52

Interactive Data Integration Technology Management 52

Domino Data Lab

APRIL 3, 2019

Paco Nathan ‘s latest column dives into data governance. This month’s article features updates from one of the early data conferences of the year, Strata Data Conference – which was held just last week in San Francisco. In particular, here’s my Strata SF talk “Overview of Data Governance” presented in article form.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

David Menninger's Analyst Perspectives

OCTOBER 7, 2021

In this post, I don’t want to debate the meanings and origins of different terms; rather, I’d like to highlight a technology weapon that you should have in your data management arsenal. We currently refer to this technology as data virtualization.

Technology 246

Technology Management Data Lake IT 246

Cloudera

MAY 28, 2024

The unpredictability of market shifts and the evolving use of new technologies means businesses need more data they can trust than ever to stay agile and make the right decisions. Modern data architectures deliver key functionality in terms of flexibility and scalability of data management.

Data Architecture 88

Data Architecture Data Lake Data Warehouse Cost-Benefit 88

Ontotext

MARCH 8, 2023

Gartner predicts that graph technologies will be used in 80% of data and analytics innovations by 2025, up from 10% in 2021. Graphs boost knowledge discovery and efficient data-driven analytics to understand a company’s relationship with customers and personalize marketing, products, and services.

Enterprise 52

Enterprise Knowledge Discovery Risk Data-driven 52

AWS Big Data

DECEMBER 15, 2023

Even after identification, it’s cumbersome to implement redaction, masking, or encryption of sensitive data at scale. In this post, we provide an automated solution to detect PII data in Amazon Redshift using AWS Glue. For our solution, we use Amazon Redshift to store the data.

Data Lake 104

Data Lake Data Warehouse Big Data Structured Data 104

Data Virtualization

SEPTEMBER 16, 2020

Organizations are leveraging cloud analytics to extract useful insights from big data, which draws from a variety of sources such as mobile phones, Internet of. Organizations all over the world are migrating their IT infrastructures and applications to the cloud.

Big Data 59

Big Data Internet of Things Analytics IT 59

CIO Business Intelligence

MARCH 22, 2022

How do you introduce AI into your data and analytics infrastructure? To companies entrenched in decades-old business and IT processes, data fiefdoms, and legacy systems, the task may seem insurmountable. Which type(s) of storage consolidation you use depends on the data you generate and collect. . Outcomes you can expect.

Analytics 108

Analytics Key Performance Indicator Data Warehouse Data-driven 108

Alation

MAY 16, 2023

Data is a valuable resource, especially in the world of business. A McKinsey survey found that companies that use customer analytics intensively are 19 times higher to achieve above-average profitability. But with the sheer amount of data continually increasing, how can a business make sense of it? Robust data pipelines.

Data Lake 69

Data Lake Data Governance Data Warehouse Data Processing 69

IBM Big Data Hub

APRIL 27, 2022

What’s a data fabric? Gartner defines a data fabric as “a design concept that serves as an integrated layer of data and connecting processes. The data fabric architectural approach can simplify data access in an organization and facilitate self-service data consumption at scale. What’s a data mesh?

Management 80

Management Metadata Data Architecture Data Lake 80

AWS Big Data

MARCH 26, 2024

In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges. We recommend building your data strategy around five pillars of C360, as shown in the following figure.

Data Strategy 69

Data Strategy Strategy Data Warehouse Prescriptive Analytics 69

CIO Business Intelligence

MAY 24, 2022

Data has always been fundamental to business, but as organisations continue to move to Cloud based environments coupled with advances in technology like streaming and real-time analytics, building a data driven business is one of the keys to success. There are many attributes a data-driven organisation possesses.

Data-driven 92

Data-driven Data Lake Data Warehouse Cost-Benefit 92

AWS Big Data

JULY 13, 2023

Data quality for account and customer data – Altron wanted to enable data quality and data governance best practices. Goals – Lay the foundation for a data platform that can be used in the future by internal and external stakeholders. A set of QuickSight dashboards to be consumed via browser and mobile.

Optimization 91

Optimization B2B Data Quality Sales 91

Alation

MAY 16, 2023

Data is a valuable resource, especially in the world of business. A McKinsey survey found that companies that use customer analytics intensively are 19 times higher to achieve above-average profitability. But with the sheer amount of data continually increasing, how can a business make sense of it? Robust data pipelines.

Data Lake 40

Data Lake Data Governance Data Warehouse Data Processing 40

Alation

JANUARY 13, 2022

Thoughtworks says data mesh is key to moving beyond a monolithic data lake. Spoiler alert: data fabric and data mesh are independent design concepts that are, in fact, quite complementary. Thoughtworks says data mesh is key to moving beyond a monolithic data lake 2. Gartner on Data Fabric.

Data Lake 59

Data Lake Metadata Data-driven Data Governance 59

IBM Big Data Hub

OCTOBER 12, 2023

Once trained and deployed, models also need reliable access to historical and real-time data to generate content, make recommendations, detect errors, send proactive alerts, etc. To optimize data analytics and AI workloads, organizations need a data store built on an open data lakehouse architecture.

Cost-Benefit 77

Cost-Benefit Metadata Data Governance Modeling 77

Data Virtualization

MAY 19, 2021

The post Credit Agricole Leverages the Denodo Platform to Streamline Data Access appeared first on Data Virtualization blog.

Management 52

Management Data Lake Data Warehouse Data Integration 52

AWS Big Data

JULY 19, 2023

Amazon Redshift is a fully managed and petabyte-scale cloud data warehouse that is used by tens of thousands of customers to process exabytes of data every day to power their analytics workload. You can structure your data, measure business processes, and get valuable insights quickly can be done by using a dimensional model.

Modeling 70

Modeling Sales Data Warehouse Snapshot 70

BI-Survey

AUGUST 21, 2020

Advanced analytics and new ways of working with data also create new requirements that surpass the traditional concepts. The following insights came from a global BARC survey into the current status of data warehouse modernization. The data landscape and the data integration tasks to be solved are often too complex.

Data Warehouse 98

Data Warehouse Data Lake Data Governance Data Architecture 98

Cloudera

MARCH 23, 2022

Figure 1: Apache Iceberg fits the next generation data architecture by abstracting storage layer from analytics layer while introducing net new capabilities like time-travel and partition evolution. #1: 1: Multi-function analytics . Flexible and open file formats. Open the door to new use-cases.

Metadata 92

Metadata Data Architecture Machine Learning Cost-Benefit 92

Data Virtualization

JANUARY 30, 2019

In this article, I will discuss the complexity of data migration when transitioning to a new system, based on the traditional ways of working. I will explain why data virtualization can play a role in taking away this complexity, for. The post How Much Time Could Your Company Save If You Said Goodbye to Data Migration?

Management 40

Management Data Lake Data Warehouse Data Integration 40

Alation

AUGUST 11, 2022

The data warehouse and analytical data stores moved to the cloud and disaggregated into the data mesh. Today, the brightest minds in our industry are targeting the massive proliferation of data volumes and the accompanying but hard-to-find value locked within all that data. This led me to Sanjeev Mohan.

Metadata 52

Metadata Data Warehouse Data Quality Data Lake 52

BI-Survey

APRIL 27, 2023

Eckerson Group wrote this report in collaboration with BARC by studying the results of a global survey of 238 data & analytics practitioners and leaders. Automate with commercial tool s Implement commercial automation tools rather than homegrown scripts because they help improve data quality and standardize and reuse tasks.

Modeling 52

Modeling Data Warehouse Data Quality Business Driver 52

AWS Big Data

MAY 19, 2023

Organizations across all industries have complex data processing requirements for their analytical use cases across different analytics systems, such as data lakes on AWS , data warehouses ( Amazon Redshift ), search ( Amazon OpenSearch Service ), NoSQL ( Amazon DynamoDB ), machine learning ( Amazon SageMaker ), and more.

Machine Learning 83

Machine Learning Metrics Big Data Management 83

AWS Big Data

NOVEMBER 13, 2023

Join the AWS Analytics team at AWS re:Invent this year, where new ideas and exciting innovations come together. For those in the data world, this post provides a curated guide for all analytics sessions that you can use to quickly schedule and build your itinerary. A shapeshifting guardian and protector of data like Data Lynx?

Analytics 111

Analytics Data Lake Data Warehouse Data-driven 111

Smarten

AUGUST 4, 2023

The Right Self-Serve Data Preparation Solution is Sophisticated, Easy-to-Use and Ensures User Adoption! When your enterprise decides to roll out analytics for business users, it is important to implement the right solution. Sophisticated Functionality – Don’t sacrifice functionality to get ease-of-use.

Data Lake 52

Data Lake Machine Learning Data Integration Optimization 52