IBM Big Data Hub

MAY 9, 2023

Over the past decade, deep learning arose from a seismic collision of data availability and sheer compute power, enabling a host of impressive AI capabilities. But these powerful technologies also introduce new risks and challenges for enterprises. Data: the foundation of your foundation model Data quality matters.

Enterprise 128

Enterprise Technology Modeling Cost-Benefit 128

CIO Business Intelligence

MARCH 18, 2024

Amid the turbulence of AI, technologies are emerging rapidly, startups are clamoring for attention, and hyperscalers are scrambling to corral market share. Brian Hopkins, vice president for emerging technology at Forrester Research, agrees. It’s an environment that taxes the decision-making skills of the even the most savvy CIOs.

Risk 133

Risk Cost-Benefit Data Processing Testing 133

AWS Big Data

DECEMBER 13, 2023

For the past 5 years, BMS has used a custom framework called Enterprise Data Lake Services (EDLS) to create ETL jobs for business users. BMS’s EDLS platform hosts over 5,000 jobs and is growing at 15% YoY (year over year). About the authors Sivaprasad Mahamkali is a Senior Streaming Data Engineer at AWS Professional Services.

Metadata 86

Metadata Data Lake Visualization Data Transformation 86

AWS Big Data

NOVEMBER 16, 2023

Amazon Redshift is a popular cloud data warehouse, offering a fully managed cloud-based service that seamlessly integrates with an organization’s Amazon Simple Storage Service (Amazon S3) data lake, real-time streams, machine learning (ML) workflows, transactional workflows, and much more—all while providing up to 7.9x

Enterprise 82

Enterprise Data Warehouse Snapshot Cost-Benefit 82

Alation

NOVEMBER 28, 2022

It is also hard to know whether one can trust the data within a spreadsheet. And they rarely, if ever, host the most current data available. Sathish Raju, cofounder & CTO, Kloudio and senior director of engineering, Alation: This presents challenges for both business users and data teams.

Metadata 52

Metadata Enterprise Cost-Benefit Finance 52

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

Data Lake 86

Data Lake Analytics Snapshot Optimization 86

CIO Business Intelligence

JANUARY 30, 2024

“Always the gatekeepers of much of the data necessary for ESG reporting, CIOs are finding that companies are even more dependent on them,” says Nancy Mentesana, ESG executive director at Labrador US, a global communications firm focused on corporate disclosure documents. What companies need more than anything is good data for ESG reporting.

Reporting 115

Reporting Data Quality Strategy Data-driven 115