AWS Big Data

APRIL 19, 2023

Many customers run big data workloads such as extract, transform, and load (ETL) on Apache Hive to create a data warehouse on Hadoop. Instead, we can use automation to speed up the process of migration and reduce heavy lifting tasks, costs, and risks. The script generates a metadata JSON file for each step.

Metadata 82

Metadata Testing Data Lake Consulting 82

AWS Big Data

MARCH 1, 2024

One of the bank’s key challenges related to strict cybersecurity requirements is to implement field level encryption for personally identifiable information (PII), Payment Card Industry (PCI), and data that is classified as high privacy risk (HPR). Only users with required permissions are allowed to access data in clear text.

Data Lake 101

Data Lake Data Warehouse Management Risk 101

Domino Data Lab

APRIL 3, 2019

Data governance shows up as the fourth-most-popular kind of solution that enterprise teams were adopting or evaluating during 2019. That’s a lot of priorities – especially when you group together closely related items such as data lineage and metadata management which rank nearby. We keep feeding the monster data.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

Domino Data Lab

JULY 22, 2019

The data governance, however, is still pretty much over on the data warehouse. Toward the end of the 2000s is when you first started getting teams and industry, as Josh Willis was showing really brilliantly last night, you first started getting some teams identified as “data science” teams.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109