IBM Big Data Hub

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

Cloudera

JUNE 7, 2022

In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 110

IT Data Architecture Unstructured Data Big Data 110

AWS Big Data

MARCH 2, 2023

Apache Iceberg is an open table format for very large analytic datasets, which captures metadata information on the state of datasets as they evolve and change over time. Iceberg has become very popular for its support for ACID transactions in data lakes and features like schema and partition evolution, time travel, and rollback.

Data Lake 120

Data Lake Data Processing Metadata Snapshot 120

Cloudera

SEPTEMBER 15, 2022

Structured data (such as name, date, ID, and so on) will be stored in regular SQL databases like Hive or Impala databases. There are also newer AI/ML applications that need data storage, optimized for unstructured data using developer friendly paradigms like Python Boto API. FILE_SYSTEM_OPTIMIZED Bucket (“FSO”).

Metadata 87

Metadata Big Data Optimization Unstructured Data 87

Ontotext

DECEMBER 16, 2020

In its third generation, Ontotext Platform enables organizations to build, use and evolve knowledge graphs as a hub for data, metadata and content. Ontotext Knowledge Graph Platform: The Modern Way of Building Smart Enterprise Applications. Check out Ontotext Platform 3.1 , 3.2 , and 3.3.

Metadata 52

Metadata Unstructured Data Visualization Enterprise 52

CIO Business Intelligence

JUNE 23, 2022

In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB. But this is not your grandfather’s big data.

IT 72

IT Data Architecture Unstructured Data Big Data 72

IBM Big Data Hub

JANUARY 5, 2023

Ill-timed business decisions and misinformed business processes, missed revenue opportunities, failed business initiatives and complex data systems can all stem from data quality issues. Several factors determine the quality of your enterprise data like accuracy, completeness, consistency, to name a few.

Data Quality 52

Data Quality Data Architecture Strategy Data Lake 52

Andrew White

DECEMBER 9, 2019

The client had recently engaged with a well-known consulting company that had recommended a large data catalog effort to collect all enterprise metadata to help identify all data and business issues. With this, the recommendation was the formation of a large enterprise data governance board with CEO sponsorship.

Analytics 66

Analytics Data Lake Data Governance Metadata 66

Ontotext

NOVEMBER 22, 2020

Ontotext’s extensive experience of bringing enterprise-level to national and global brands understands this and has for over a decade strived to make the power of semantic technology accessible. From packaging and deployment to monitoring tools and report generations, the Platform has everything an enterprise needs.

Metadata 72

Metadata Cost-Benefit Unstructured Data Technology 72

AWS Big Data

FEBRUARY 21, 2023

Because data is closer to the source and stored in raw format, it has to be transformed before it can be used for reporting and other application purposes. This is one of the biggest hurdles with the data vault approach. It is a data modeling methodology designed for large-scale data warehouse platforms.

Data Warehouse 67

Data Warehouse Data Lake Cost-Benefit Modeling 67

IBM Big Data Hub

FEBRUARY 14, 2024

IBM Research is working to help its customers use generative models to write high-quality software code faster, discover new molecules , and train trustworthy conversational chatbots grounded on enterprise data. Generative AI excels at handling diverse data sources such as emails, images, videos, audio files and social media content.

Cost-Benefit 83

Cost-Benefit Insurance Unstructured Data Machine Learning 83

CIO Business Intelligence

MARCH 29, 2022

Organizations may acquire a lot of data, but they aren’t getting much value from it. It is estimated that nearly 75% of the data that enterprises collect remains unused, and thus, the value is not realized. You have data but don’t use it. Why does valuable data so often go unused? So, what is the problem?

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Data Quality 52

AWS Big Data

JANUARY 8, 2024

This is the first post to a blog series that offers common architectural patterns in building real-time data streaming infrastructures using Kinesis Data Streams for a wide range of use cases. In this post, we will review the common architectural patterns of two use cases: Time Series Data Analysis and Event Driven Microservices.

Analytics 115

Analytics IoT Data-driven Snapshot 115

AWS Big Data

MARCH 25, 2024

Streaming jobs constantly ingest new data to synchronize across systems and can perform enrichment, transformations, joins, and aggregations across windows of time more efficiently. For building such a data store, an unstructured data store would be best.

Data Lake 92

Data Lake Unstructured Data Management Modeling 92

Cloudera

AUGUST 21, 2020

Perhaps one of the most significant contributions in data technology advancement has been the advent of “Big Data” platforms. Historically these highly specialized platforms were deployed on-prem in private data centers to ensure greater control , security, and compliance. Streaming data analytics. .

Cost-Benefit 74

Cost-Benefit Big Data ROI Risk 74