TDAN

JUNE 1, 2021

I vividly remember reading this passage from Bob Seiner’s TDAN.com article “Things I Think I Think about Data Governance”, from August 1, 2015: If we were going to remove two words from the Data Governance vocabulary, I would choose the words “assign” and “owner. When someone is designated as the “owner” of data, that implies […].

Data Governance 98

Data Governance Metadata Data Strategy Strategy 98

AWS Big Data

NOVEMBER 17, 2023

Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata. About the Authors Darshit Thakkar is a Technical Product Manager with AWS and works with the Amazon Athena team based out of Boston, Massachusetts.

Optimization 113

Optimization Statistics Metadata Data Lake 113

AWS Big Data

FEBRUARY 1, 2023

To further optimize and improve the developer velocity for our data consumers, we added Amazon DynamoDB as a metadata store for different data sources landing in the data lake. With AWS Glue, you can discover and connect to more than 70 diverse data sources and manage your data in a centralized data catalog.

Optimization 52

Optimization Forecasting Data Lake Metadata 52

Cloudera

APRIL 21, 2022

So how exactly is the EHR managing petabytes of data? Most of the massive data-management tasks DoD faces fall into that area where data, analytics, and the cloud intersect. The centerpiece of MHS Genesis is Cerner’s Millennium services management platform, which provides hosted software-as-a-service functionality in the cloud.

Metadata 86

Metadata Informatics Insurance Data Processing 86

Domino Data Lab

JULY 2, 2019

In other words, using metadata about data science work to generate code. One of the longer-term trends that we’re seeing with Airflow , and so on, is to externalize graph-based metadata and leverage it beyond the lifecycle of a single SQL query, making our workflows smarter and more robust. BTW, videos for Rev2 are up: [link].

Metadata 105

Metadata Machine Learning Data Science Data-driven 105

AWS Big Data

JULY 26, 2023

The vector engine provides a simple, scalable, and high-performing similarity search capability in Amazon OpenSearch Serverless that makes it easy for you to build modern machine learning (ML) augmented search experiences and generative artificial intelligence (AI) applications without having to manage the underlying vector database infrastructure.

Metadata 52

Metadata Cost-Benefit Testing Metrics 52

Cloudera

DECEMBER 9, 2022

Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. What if there was a way to not require developers to manage their own Apache NiFi installation without putting that burden on platform administrators?

Testing 98

Testing Cost-Benefit Interactive Visualization 98

Rita Sallam

APRIL 2, 2023

To extend the Bake-Off experience to a broader range of vendors, including smaller innovators, we also did a series of Show Floor Showdowns for analytics and BI, data science and machine learning and for data management. This reinforces the demand for workload management and separate optimization techniques.

Optimization 52

Optimization Machine Learning Insurance Risk 52

Cloudera

JUNE 16, 2022

In 2015, Cloudera became one of the first vendors to provide enterprise support for Apache Kafka, which marked the genesis of the Cloudera Stream Processing (CSP) offering. Today, CSP is powered by Apache Flink and Kafka and provides a complete, enterprise-grade stream management and stateful processing solution.

Data Lake 86

Data Lake Manufacturing Metadata Dashboards 86

CIO Business Intelligence

SEPTEMBER 6, 2022

It launched its first online-only brand, Very, in 2009 and finally abandoned its printed catalogs to go all-in online in 2015. Instead, says Pimblett, he and his data colleagues ask business managers, “Where do you think you can create value from data? Chief Data Officer, Data Center Management million daily website visits, 4.8

IT 74

IT Forecasting Data Lake Enterprise 74

In(tegrate) the Clouds

DECEMBER 21, 2015

Merv Adrian (@merv) December 19, 2015. What is the most important news item about a software company that occurred in 2015 that belongs in the capsule, and why? The resurgence of Microsoft as a cloud company was big news in 2015. Who was the biggest tech disruptor in 2015? platform.twitter.com/widgets.js.

Technology 45

Technology Internet of Things Digital Transformation Software 45

AWS Big Data

JUNE 6, 2023

Since we started exporting GA tracking data to BigQuery in 2015 the amount of data tracked and stored has grown 70x (logical bytes) and is >3TB in total. Data Catalog: We also wanted to automate a Glue Crawler to have metadata in a Data Catalog and be able to explore our files in S3 with Athena.

Analytics 55

Analytics Data Lake Testing Optimization 55

Peter James Thomas

AUGUST 18, 2018

From 2000 to 2015, I had some success [5] with designing and implementing Data Warehouse architectures much like the following: As a lot of my work then was in Insurance or related fields, the Analytical Repositories tended to be Actuarial Databases and / or Exposure Management Databases, developed in collaboration with such teams.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

Jet Global

MAY 27, 2021

Chrome: September 2015. Back in 2014, The Lab Consulting wrote in CFO.com about the waste that exists in management reporting. A way that gives business users the flexible reporting they need while reducing the burden on IT to manage those reports. Cash Management. Fewer reports to manage. FireFox: September 2018.

Reporting 52

Reporting Cost-Benefit Dashboards Finance 52

Andrew White

JANUARY 9, 2022

– This is a question for our data management team. – Here is a very popular data fabric resources: Data Fabric Architecture is Key to Modernizing Data Management and Integration. . It is a name we use to denote that a role or practice is adopted in the wild without any formal structure or management. Try Mark Beyer.

Analytics 64

Analytics Measurement Modeling Data-driven 64