Data Virtualization

MARCH 16, 2023

Reading Time: 6 minutes Data lake, by combining the flexibility of object storage with the scalability and agility of cloud platforms, are becoming an increasingly popular choice as an enterprise data repository. Whether you are on Amazon Web Services (AWS) and leverage AWS S3.

Data Lake 52

Data Lake Strategy Data Integration Enterprise 52

AWS Big Data

MARCH 10, 2023

Since the deluge of big data over a decade ago, many organizations have learned to build applications to process and analyze petabytes of data. Data lakes have served as a central repository to store structured and unstructured data at any scale and in various formats.

Data Lake 100

Data Lake Sales Data Warehouse Snapshot 100

AWS Big Data

FEBRUARY 24, 2023

Data lakes are a popular choice for today’s organizations to store their data around their business activities. As a best practice of a data lake design, data should be immutable once stored. A data lake built on AWS uses Amazon Simple Storage Service (Amazon S3) as its primary storage environment.

Data Lake 81

Data Lake Metadata Testing Data Warehouse 81

Analytics Vidhya

OCTOBER 10, 2022

Introduction In the modern data world, Lakehouse has become one of the most discussed topics for building a data platform. Enterprises have slowly started adopting Lakehouses for their data ecosystems as they offer cost efficiencies of data lakes and the performance of warehouses. […].

Data Lake 336

Data Lake Data Science Publishing Enterprise 336

Jet Global

NOVEMBER 5, 2020

Ostensibly, the new product represents Microsoft’s transition to a newer, more cloud-friendly ERP for midsized enterprises. Option 3: Azure Data Lakes. This leads us to Microsoft’s apparent long-term strategy for D365 F&SCM reporting: Azure Data Lakes. Data lakes are not a mature technology.

Data Lake 98

Data Lake OLAP Data Warehouse Unstructured Data 98

David Menninger's Analyst Perspectives

FEBRUARY 21, 2024

Unstructured data has been a significant factor in data lakes and analytics for some time. Twelve years ago, nearly a third of enterprises were working with large amounts of unstructured data. As I’ve pointed out previously , unstructured data is really a misnomer.

Unstructured Data 144

Unstructured Data Data Lake Enterprise Technology 144

David Menninger's Analyst Perspectives

SEPTEMBER 16, 2021

Rapidminer is a visual enterprise data science platform that includes data extraction, data mining, deep learning, artificial intelligence and machine learning (AI/ML) and predictive analytics. It can support AI/ML processes with data preparation, model validation, results visualization and model optimization.

Data Science 319

Data Science Data Lake Data mining Deep Learning 319

BizAcuity

MARCH 29, 2019

Data lakes are centralized repositories that can store all structured and unstructured data at any desired scale. The power of the data lake lies in the fact that it often is a cost-effective way to store data. The power of the data lake lies in the fact that it often is a cost-effective way to store data.

Data Lake 102

Data Lake Unstructured Data Cost-Benefit Data Quality 102

Analytics Vidhya

FEBRUARY 27, 2023

Introduction Enterprises here and now catalyze vast quantities of data, which can be a high-end source of business intelligence and insight when used appropriately. Delta Lake allows businesses to access and break new data down in real time.

Data Lake 242

Data Lake Business Intelligence Enterprise Analytics 242

Jet Global

SEPTEMBER 4, 2020

There is an established body of practice around creating, managing, and accessing OLAP data (known as “cubes”). Data Lakes. There has been a lot of talk over the past year or two in the D365F&SCM world about “data lakes.” Traditional databases and data warehouses do not lend themselves to that task.

Data Lake 88

Data Lake OLAP Data Warehouse Unstructured Data 88

Smart Data Collective

APRIL 2, 2019

Data Lakes are among the most complex and sophisticated data storage and processing facilities we have available to us today as human beings. Analytics Magazine notes that data lakes are among the most useful tools that an enterprise may have at its disposal when aiming to compete with competitors via innovation.

Data Lake 82

Data Lake Big Data OLAP Testing 82

Jet Global

JULY 2, 2019

The sheer scale of data being captured by the modern enterprise has necessitated a monumental shift in how that data is stored. What was at first a data stream has morphed into a data river as enterprise businesses are harvesting reams of data from every conceivable input across every conceivable business function.

Data Lake 73

Data Lake Data Warehouse Big Data Machine Learning 73

Cloudera

JUNE 2, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. What is the modern data stack? In the modern data stack, there is a diverse set of destinations where data needs to be delivered.

Enterprise 101

Enterprise Data Lake Data Collection Data-driven 101

CIO Business Intelligence

OCTOBER 25, 2023

From IT, to finance, marketing, engineering, and more, AI advances are causing enterprises to re-evaluate their traditional approaches to unlock the transformative potential of AI. What can enterprises learn from these trends, and what future enterprise developments can we expect around generative AI?

Enterprise 126

Enterprise Risk Manufacturing Finance 126

erwin

SEPTEMBER 3, 2020

Why should you integrate data governance (DG) and enterprise architecture (EA)? Two of the biggest challenges in creating a successful enterprise architecture initiative are: collecting accurate information on application ecosystems and maintaining the information as application ecosystems change.

Data Governance 144

Data Governance Enterprise Risk Data Lake 144

AWS Big Data

APRIL 24, 2023

Building a data lake on Amazon Simple Storage Service (Amazon S3) provides numerous benefits for an organization. However, many use cases, like performing change data capture (CDC) from an upstream relational database to an Amazon S3-based data lake, require handling data at a record level.

Data Lake 78

Data Lake Data Governance Cost-Benefit Machine Learning 78

IBM Big Data Hub

MAY 9, 2023

We can use foundation models to quickly perform tasks with limited annotated data and minimal effort; in some cases, we need only to describe the task at hand to coax the model into solving it. But these powerful technologies also introduce new risks and challenges for enterprises.

Enterprise 129

Enterprise Technology Modeling Cost-Benefit 129

erwin

AUGUST 15, 2022

For NoSQL, data lakes, and data lake houses—data modeling of both structured and unstructured data is somewhat novel and thorny. This blog is an introduction to some advanced NoSQL and data lake database design techniques (while avoiding common pitfalls) is noteworthy. Data Modeling.

Data Lake 52

Data Lake Modeling Unstructured Data Data Warehouse 52

CIO Business Intelligence

SEPTEMBER 21, 2023

Generative AI touches every aspect of the enterprise, and every aspect of society,” says Bret Greenstein, partner and leader of the gen AI go-to-market strategy at PricewaterhouseCoopers. Gen AI is that amplification and the world’s reaction to it is like enterprises and society reacting to the introduction of a foreign body. “We

Enterprise 126

Enterprise Consulting Modeling Cost-Benefit 126

AWS Big Data

MARCH 4, 2024

As enterprises collect increasing amounts of data from various sources, the structure and organization of that data often need to change over time to meet evolving analytical needs. Schema evolution enables adding, deleting, renaming, or modifying columns without needing to rewrite existing data.

Snapshot 110

Snapshot Data Lake Metadata Recreation/Entertainment 110

AWS Big Data

NOVEMBER 16, 2023

Amazon Redshift is a popular cloud data warehouse, offering a fully managed cloud-based service that seamlessly integrates with an organization’s Amazon Simple Storage Service (Amazon S3) data lake, real-time streams, machine learning (ML) workflows, transactional workflows, and much more—all while providing up to 7.9x

Enterprise 82

Enterprise Data Warehouse Snapshot Cost-Benefit 82

bridgei2i

SEPTEMBER 23, 2020

WEBCAST: Automated Business Surveillance for Enterprises with BRIDGEi2i’s Watchtower. As businesses grow complex, tracking signals from separate functions becomes difficult; data flows from all domains and verticals. Enterprises need to be highly responsive to any anomalies and to derive actionable insights faster.

Enterprise 97

Enterprise Unstructured Data Data Lake Digital Transformation 97

CIO Business Intelligence

JULY 13, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. What is the modern data stack? In the modern data stack, there is a diverse set of destinations where data needs to be delivered.

Enterprise 59

Enterprise Data Lake Data Collection Data-driven 59

CIO Business Intelligence

SEPTEMBER 20, 2023

The data can also help us enrich our commodity products. How are you populating your data lake? We’ve decided to take a practical approach, led by Kyle Benning, who runs our data function. Then our analytics team, an IT group, makes sure we build the data lake in the right sequence.

Data Lake 113

Data Lake Data-driven Dashboards Risk 113

AWS Big Data

JANUARY 17, 2024

With Amazon EMR 6.15, we launched AWS Lake Formation based fine-grained access controls (FGAC) on Open Table Formats (OTFs), including Apache Hudi, Apache Iceberg, and Delta lake. Many large enterprise companies seek to use their transactional data lake to gain insights and improve decision-making.

Data Lake 91

Data Lake Snapshot Big Data Data-driven 91

AWS Big Data

MARCH 7, 2024

At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. With this massive data growth, data proliferation across your data stores, data warehouse, and data lakes can become equally challenging.

Data Lake 111

Data Lake Analytics Dashboards Metrics 111

AWS Big Data

FEBRUARY 29, 2024

Data is your generative AI differentiator, and a successful generative AI implementation depends on a robust data strategy incorporating a comprehensive data governance approach. Data governance is a critical building block across all these approaches, and we see two emerging areas of focus.

Data Governance 93

Data Governance Unstructured Data Metadata Data Lake 93

IBM Big Data Hub

AUGUST 2, 2019

The pressure is rising for business users, automation, and governed data lakes to drive business value. Learn how enterprise data preparation fits in.

Enterprise 78

Enterprise Data Lake 78

Ontotext

APRIL 10, 2024

Data ecosystems have become jungles and in spite of all the technology, data teams are struggling to create a modern data experience. Drowning in Data, Thirsting for Context We’ve heard the saying, “Data, data everywhere. ” As more data accumulates, context gets diluted and lost.

Metadata 52

Metadata Data Lake Data Warehouse Data Quality 52

DataKitchen

NOVEMBER 4, 2021

Cloud computing has made it much easier to integrate data sets, but that’s only the beginning. Creating a data lake has become much easier, but that’s only ten percent of the job of delivering analytics to users. It often takes months to progress from a data lake to the final delivery of insights.

Data Processing 246

Data Processing Data Lake Cost-Benefit Testing 246

Boris Evelson

JUNE 14, 2023

Enterprise business intelligence (BI) continues to be the last mile to insights-driven business (IDB) capabilities. No matter what technology foundation you’re using – a data lake, a data warehouse, data fabric, data mesh, etc.

Business Intelligence 98

Business Intelligence Data Lake Data Warehouse Data-driven 98

AWS Big Data

JANUARY 12, 2024

Ingestion: Data lake batch, micro-batch, and streaming Many organizations land their source data into their data lake in various ways, including batch, micro-batch, and streaming jobs. Amazon AppFlow can be used to transfer data from different SaaS applications to a data lake.

Data Lake 92

Data Lake Cost-Benefit Visualization Structured Data 92

AWS Big Data

OCTOBER 20, 2023

Today, we are pleased to announce new AWS Glue connectors for Azure Blob Storage and Azure Data Lake Storage that allow you to move data bi-directionally between Azure Blob Storage, Azure Data Lake Storage, and Amazon Simple Storage Service (Amazon S3). option("header","true").load("wasbs://yourblob@youraccountname.blob.core.windows.net/loadingtest-input/100mb")

Data Lake 82

Data Lake Big Data Consulting Data Warehouse 82

DataKitchen

AUGUST 3, 2021

The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. But first, let’s define the data mesh design pattern. The past decades of enterprise data platform architectures can be summarized in 69 words.

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

Dataiku

SEPTEMBER 1, 2023

Lately, the concept of data experience has been gaining attention in discussions around the enterprise data stack. As the name suggests, it refers to how people interact with data in enterprise settings. Due to fragmented data setups in these companies, their data lakes have the following characteristics:

Data Lake 69

Data Lake Data Analytics Analytics Interactive 69