AWS Big Data

APRIL 3, 2024

Today, we are pleased to announce that Amazon DataZone is now able to present data quality information for data assets. Other organizations monitor the quality of their data through third-party solutions. Additionally, Amazon DataZone now offers APIs for importing data quality scores from external systems.

Data Quality 88

Data Quality Visualization Metadata Metrics 88

Alation

DECEMBER 15, 2022

December 2012: Alation forms and goes to work creating the first enterprise data catalog. Later, in its inaugural report on data catalogs, Forrester Research recognizes that “Alation started the MLDC trend.”. May 2016: Alation named a Gartner Cool Vendor in their Data Integration and Data Quality, 2016 report.

Metadata 52

Metadata Data Governance Data Quality Marketing 52

AWS Big Data

JUNE 6, 2023

Founded in 2012, SumUp is the financial partner for more than 4 million small merchants in over 35 markets worldwide, helping them start, run and grow their business. Data Catalog: We also wanted to automate a Glue Crawler to have metadata in a Data Catalog and be able to explore our files in S3 with Athena.

Analytics 56

Analytics Data Lake Testing Optimization 56

Peter James Thomas

AUGUST 18, 2018

Even back then, these were used for activities such as Analytics , Dashboards , Statistical Modelling , Data Mining and Advanced Visualisation. Next, rather than just being the province of Data Scientists, there were moves to use Data Lakes to support general Data Discovery and even business Reporting and Analytics as well.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

AWS Big Data

DECEMBER 18, 2023

There are multiple tables related to customers and order data in the RDS database. Amazon S3 hosts the metadata of all the tables as a.csv file. This is especially true when you are processing millions of items and you expect data quality issues in the dataset.

Metadata 118

Metadata Visualization Data Lake Data-driven 118

AWS Big Data

MARCH 1, 2024

An AWS Glue Crawler scans the above files and catalogs metadata about them into the AWS Glue Data Catalog. The Glue Data Catalog organizes this Amazon S3 data into tables and databases, assigning columns and data types so the data can be queried using SQL that Amazon Redshift Spectrum can understand.

Data Lake 99

Data Lake Data Warehouse Management Risk 99

Domino Data Lab

JULY 22, 2019

Coming into the 2010s, we had data science practice, we had evolution of big data tooling, we had a lot more sophisticated use of the big data and what was going on in the cloud. I went to a meeting at Starbucks with the founder of Alation right before they launched in 2012, drawing on the proverbial back-of-the-napkin.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109