article thumbnail

Orca Security’s journey to a petabyte-scale data lake with Apache Iceberg and AWS Analytics

AWS Big Data

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

article thumbnail

Perform upserts in a data lake using Amazon Athena and Apache Iceberg

AWS Big Data

Amazon Athena supports the MERGE command on Apache Iceberg tables, which allows you to perform inserts, updates, and deletes in your data lake at scale using familiar SQL statements that are compliant with ACID (Atomic, Consistent, Isolated, Durable). The first task performs an initial copy of the full data into an S3 folder.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

How AWS helped Altron Group accelerate their vision for optimized customer engagement

AWS Big Data

Altron is a pioneer of providing data-driven solutions for their customers by combining technical expertise with in-depth customer understanding to provide highly differentiated technology solutions. Data quality for account and customer data – Altron wanted to enable data quality and data governance best practices.

article thumbnail

Your guide to AWS Analytics at AWS re:Invent 2023

AWS Big Data

11:30 AM – 12:30 PM (PDT) Ceasars Forum ANT318 | Accelerate innovation with end-to-end serverless data architecture. 4:30 PM – 5:30 PM (PDT) Wynn ANT207 | Understand your data with business context. 1:00 PM – 2:00 PM (PDT) Venetian ANT201 | Accelerate innovation with real-time data.

Analytics 111
article thumbnail

Reference guide to build inventory management and forecasting solutions on AWS

AWS Big Data

Accurately predicting demand for products allows businesses to optimize inventory levels, minimize stockouts, and reduce holding costs. Solution overview In today’s highly competitive business landscape, it’s essential for retailers to optimize their inventory management processes to maximize profitability and improve customer satisfaction.

article thumbnail

Real-time streaming data top picks you cannot miss at AWS re:Invent 2023

AWS Big Data

Join us as we delve into the world of real-time streaming data at re:Invent 2023 and discover how you can use real-time streaming data to build new use cases, optimize existing projects and processes, and reimagine what’s possible. High-quality data is not just about accuracy; it’s also about timeliness.

article thumbnail

Moving Enterprise Data From Anywhere to Any System Made Easy

Cloudera

This blog aims to answer two questions: What is a universal data distribution service? Why does every organization need it when using a modern data stack? Every organization on the hybrid cloud journey needs the ability to take control of their data flows from origination through all points of consumption.