AWS Big Data

SEPTEMBER 29, 2023

XML files are well-suited for applications, but they may not be optimal for analytics engines. To analyze XML files stored in Amazon S3 using AWS Glue and Athena, we complete the following high-level steps: Create an AWS Glue crawler to extract XML metadata and create a table in the AWS Glue Data Catalog. Choose Create.

Metadata 65

Metadata Visualization Data-driven Optimization 65

AWS Big Data

AUGUST 28, 2023

By converting logs and events using Open Cybersecurity Schema Framework , an open standard for storing security events in a common and shareable format, Security Lake optimizes and normalizes your security data for analysis using your preferred analytics tool. In the Specify permissions section, choose JSON to open the policy editor.

Dashboards 52

Dashboards Visualization Metadata Management 52

AWS Big Data

JANUARY 22, 2024

Data as a product Treating data as a product entails three key components: the data itself, the metadata, and the associated code and infrastructure. For orchestration, they use the AWS Cloud Development Kit (AWS CDK) for infrastructure as code (IaC) and AWS Glue Data Catalogs for metadata management.

Data-driven 87

Data-driven Advertising Metadata Data Architecture 87

O'Reilly on Data

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Consulting 245

Consulting Interactive Software IT 245

Domino Data Lab

JULY 22, 2019

I went to a meeting at Starbucks with the founder of Alation right before they launched in 2012, drawing on the proverbial back-of-the-napkin. The problems down in the mature bucket, those are optimizations, they aren’t showstoppers. Machine learning is a subset of mathematical optimization.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

O'Reilly on Data

MAY 21, 2019

Consider deep learning, a specific form of machine learning that resurfaced in 2011/2012 due to record-setting models in speech and computer vision. Metadata and artifacts needed for audits. Another algorithm (the “trainer” and “pipeline”) that uses data to produce the Model that best optimizes some objective function.

Machine Learning 234

Machine Learning Technology Deep Learning Data Science 234

Domino Data Lab

SEPTEMBER 9, 2019

Let’s analyze text data from the party conventions during the 2012 US Presidential elections. metadata=convention_df["speaker"]? ). Here’s an interactive visualization for understanding texts: scattertext , a product of the genius of Jason Kessler. get_data(). ? category="democrat",?. width_in_pixels=1000,?.

Deep Learning 110

Deep Learning Machine Learning Data Science Visualization 110