AWS Big Data

NOVEMBER 17, 2023

You can analyze data or build applications from an Amazon Simple Storage Service (Amazon S3) data lake and 30 data sources, including on-premises data sources or other cloud systems using SQL or Python. Let’s discuss some of the cost-based optimization techniques that contributed to improved query performance.

Optimization 112

Optimization Statistics Metadata Data Lake 112

AWS Big Data

JANUARY 24, 2024

AWS-powered data lakes, supported by the unmatched availability of Amazon Simple Storage Service (Amazon S3), can handle the scale, agility, and flexibility required to combine different data and analytics approaches. The timestamp clause lets us travel back without altering current data.

Snapshot 100

Snapshot Data Lake Metadata Optimization 100

AWS Big Data

OCTOBER 23, 2023

Modern applications store massive amounts of data on Amazon Simple Storage Service (Amazon S3) data lakes, providing cost-effective and highly durable storage, and allowing you to run analytics and machine learning (ML) from your data lake to generate insights on your data.

Data Lake 101

Data Lake Visualization Optimization Interactive 101

AWS Big Data

JUNE 6, 2023

In this post we showcase how we used AWS Glue to move siloed digital analytics data, with inconsistent arrival times, to AWS S3 (our Data Lake) and our central data warehouse (DWH), Snowflake. AWS Glue gave us a cost-efficient option to migrate the data and we further optimized storage cost by pruning cold data.

Analytics 56

Analytics Data Lake Testing Optimization 56

AWS Big Data

JULY 28, 2023

Recently, Athena added support for creating and querying views on federated data sources to bring greater flexibility and ease of use to use cases such as interactive analysis and business intelligence reporting. Big Data Architect on Amazon Athena. Let’s dive into the solution. Pathik Shah is a Sr.

Big Data 77

Big Data Data Architecture Data Lake Interactive 77

Cloudera

DECEMBER 19, 2018

Data analytics priorities have shifted this year. Don’t blink or you might miss what leading organizations are doing to modernize their analytic and data warehousing environments. Natural language analytics and streaming data analytics are emerging technologies that will impact the market.

Data Warehouse 52

Data Warehouse Analytics Big Data Data Architecture 52

Cloudera

JUNE 16, 2022

Organizations are increasingly building low-latency, data-driven applications, automations, and intelligence from real-time data streams. Cloudera Stream Processing (CSP) enables customers to turn streams into data products by providing capabilities to analyze streaming data for complex patterns and gain actionable intel.

Data Lake 84

Data Lake Manufacturing Metadata Dashboards 84