AWS Big Data

FEBRUARY 16, 2023

As a QuickSight administrator, you can use AWS CloudFormation templates to migrate assets between distinct environments from development, to test, to production. For more details, refer to Amazon QuickSight resource type reference. An Amazon Redshift cluster with sample data loaded.

Data Warehouse 83

Data Warehouse Sales Visualization Data Processing 83

AWS Big Data

MAY 7, 2024

It also makes it easier for engineers, data scientists, product managers, analysts, and business users to access data throughout an organization to discover, use, and collaborate to derive data-driven insights. Note that a managed data asset is an asset for which Amazon DataZone can manage permissions.

Metadata 77

Metadata Data Lake Data Processing Data-driven 77

AWS Big Data

OCTOBER 17, 2023

Tens of thousands of customers use Amazon Redshift to gain business insights from their data. With Amazon Redshift, you can use standard SQL to query data across your data warehouse, operational data stores, and data lake. For more information, refer to Configuring ongoing data replication.

Data Warehouse 88

Data Warehouse Data Processing Data Lake Management 88

AWS Big Data

MAY 30, 2023

Customers have been using data warehousing solutions to perform their traditional analytics tasks. Recently, data lakes have gained lot of traction to become the foundation for analytical solutions, because they come with benefits such as scalability, fault tolerance, and support for structured, semi-structured, and unstructured datasets.

Data Lake 83

Data Lake Data Analytics Analytics Data Processing 83

AWS Big Data

APRIL 26, 2024

Use Lake Formation to grant permissions to users to access data. Test the solution by accessing data with a corporate identity. Audit user data access. For a complete guide on creating and providing a certificate, refer to Providing certificates for encrypting data in transit with Amazon EMR encryption.

Analytics 97

Analytics Data Lake Management Enterprise 97

Domino Data Lab

APRIL 3, 2019

“Flashpoint” (2018) – GDPR went into effect, plus major data blunders happened seemingly everywhere. Fun fact : I co-founded an e-commerce company (realistically, a mail-order catalog hosted online) in December 1992 using one of those internetworking applications called Gopher , which was vaguely popular at the time.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

AWS Big Data

DECEMBER 18, 2023

Solution overview One of the common functionalities involved in data pipelines is extracting data from multiple data sources and exporting it to a data lake or synchronizing the data to another database. For more information, refer to IAM Policies for invoking AWS Glue job from Step Functions.

Metadata 123

Metadata Visualization Data Lake Data-driven 123

AWS Big Data

OCTOBER 23, 2023

Modern applications store massive amounts of data on Amazon Simple Storage Service (Amazon S3) data lakes, providing cost-effective and highly durable storage, and allowing you to run analytics and machine learning (ML) from your data lake to generate insights on your data.

Data Lake 104

Data Lake Visualization Optimization Interactive 104

AWS Big Data

JUNE 13, 2023

For instructions on installing Keycloak, refer to Keycloak Downloads. Insert your specific host domain name where the Keycloak application resides in the following URL: [link] /realms/aws-realm/protocol/saml/descriptor. Vamsi Bhadriraju is a Data Architect at AWS. Sign in to your Keycloak admin dashboard.

Metadata 52

Metadata Dashboards Business Intelligence Management 52

Cloudera

JUNE 6, 2019

The typical Cloudera Enterprise Data Hub Cluster starts with a few dozen nodes in the customer’s datacenter hosting a variety of distributed services. Over time, workloads start processing more data, tenants start onboarding more workloads, and administrators (admins) start onboarding more tenants. Cloudera Manager (CM) 6.2

Metadata 85

Metadata Data Lake Optimization Strategy 85

Cloudera

OCTOBER 7, 2021

Those decentralization efforts appeared under different monikers through time, e.g., data marts versus data warehousing implementations (a popular architectural debate in the era of structured data) then enterprise-wide data lakes versus smaller, typically BU-Specific, “data ponds”.

Metadata 122

Metadata Cost-Benefit Enterprise Interactive 122

Andrew White

JANUARY 11, 2021

On January 4th I had the pleasure of hosting a webinar. It was titled, The Gartner 2021 Leadership Vision for Data & Analytics Leaders. This was for the Chief Data Officer, or head of data and analytics. It is meant to be a desk-reference for that role for 2021. Data lakes don’t offer this nor should they.

Data Analytics 52

Data Analytics Analytics Data-driven Finance 52

Jet Global

FEBRUARY 23, 2024

ETL is beneficial for larger data volumes and diverse sources, and may be necessary for data architects, developers, and administrators considering factors like volume, source diversity, accuracy, and efficiency. Data Migration Data migration refers to the process of transferring data from one location or format to another.

Data Warehouse 52

Data Warehouse Reporting Data Transformation Sales 52