article thumbnail

Extract time series from satellite weather data with AWS Lambda

AWS Big Data

It has not been specifically designed for heavy data transformation tasks. But before starting, we need to download the dataset and upload it to an S3 bucket. Prerequisites Create an S3 bucket to store the input dataset, the intermediate outputs, and the final outputs of the data extraction.

article thumbnail

Lay the groundwork now for advanced analytics and AI

CIO Business Intelligence

Using SnapLogic ’s integration platform freed his developers from manually building APIs (application programming interfaces) for each data source, and helped with cleaning the data and storing it quickly and efficiently in the warehouse, he says. It takes a lot of grunt work, but with that work done, one can do amazing things.”

article thumbnail

Gain insights from historical location data using Amazon Location Service and AWS analytics services

AWS Big Data

You can also use the data transformation feature of Data Firehose to invoke a Lambda function to perform data transformation in batches. During his professional career, he has been extensively involved in complex digital transformation projects.