AWS Big Data

APRIL 11, 2023

Such a solution should use the latest technologies, including Internet of Things (IoT) sensors, cloud computing, and machine learning (ML), to provide accurate, timely, and actionable data. In this post, we discuss how to streamline inventory management forecasting systems with AWS managed analytics, AI/ML, and database services.

Forecasting 76

Forecasting Management IoT Data-driven 76

Alation

FEBRUARY 13, 2020

It is about hurricanes and big events like the California wildfires, but it is also about complex things like satellite launches, for example, or big building projects. A lot of people in our audience are looking at implementing data lakes or are in the middle of big data lake initiatives.

Data-driven 52

Data-driven Data Lake Enterprise Analytics 52

CIO Business Intelligence

JUNE 20, 2022

Otis One’s cloud-native platform is built on Microsoft Azure and taps into a Snowflake data lake. IoT sensors send elevator data to the cloud platform, where analytics are applied to support business operations, including reporting, data visualization, and predictive modeling.

Internet of Things 105

Internet of Things IoT Manufacturing Data Lake 105

CIO Business Intelligence

DECEMBER 1, 2022

The $247 billion conglomerate, one of the largest food and beverage companies in the world, is developing a modernized data and cloud infrastructure replete with automated processes and workflows. One HR employee took some courses in data analytics and found a new job within the company helping to advance digital transformation.

Digital Transformation 126

Digital Transformation IoT Data-driven KPI 126

Cloudera

AUGUST 18, 2021

For those models to produce meaningful outcomes, organizations need a well-defined data lifecycle management process that addresses the complexities of capturing, analyzing, and acting on data. In modern hybrid environments, data traverses clouds, on-premise infrastructure and IoT networks, so the process can get very complex.

Data Lake 88

Data Lake IoT Internet of Things Data-driven 88

AWS Big Data

DECEMBER 13, 2023

Traditionally, customers used batch-based approaches for data movement from operational systems to analytical systems. A batch-based approach can introduce latency in data movement and reduce the value of data for analytics. usually a data warehouse) needs to reflect those changes in near real-time.

Data Warehouse 98

Data Warehouse Snapshot Data Processing Management 98

CIO Business Intelligence

SEPTEMBER 12, 2022

Collectively, the agencies also have pilots up and running to test electric buses and IoT sensors scattered throughout the transportation system. As a result, NJ Transit’s data maturity as an organization has grown. IDC analyst Sandeep Mukunda says NJ Transit’s approach to data analytics has been very advanced.

Data Warehouse 116

Data Warehouse Predictive Analytics Data Lake IoT 116

CIO Business Intelligence

JULY 12, 2023

P&G engineers developed a high-speed data collection system to capture data to use for training AI models. One challenge they faced is that, while production errors are extremely costly and disruptive, they don’t happen often, which means that failure events are underrepresented in the training data.

Manufacturing 94

Manufacturing Cost-Benefit Data Lake Optimization 94

AWS Big Data

FEBRUARY 6, 2023

The parser also has other capabilities, including sorting events by time, removing dedicates, and merging multiple logs. He helps customers innovate their business with AWS Analytics, IoT, and AI/ML services. He has a specialty in big data services and technologies and an interest in building customer business outcomes together.

Dashboards 76

Dashboards Optimization Data Lake Cost-Benefit 76

Sanjeev Mohan

JANUARY 15, 2018

You see, I write research documents, help my clients through inquiries and present at various events. Somehow the data deluge barely leaves enough oxygen for a social media dopamine fix! Look forward to blogs spanning big data technologies, advanced analytics, data governance, IoT and blockchain.

Data Lake 45

Data Lake IoT Big Data Interactive 45

AWS Big Data

JUNE 29, 2023

Amazon Kinesis Data Analytics makes it easy to transform and analyze streaming data in real time. In this post, we discuss why AWS recommends moving from Kinesis Data Analytics for SQL Applications to Amazon Kinesis Data Analytics for Apache Flink to take advantage of Apache Flink’s advanced streaming capabilities.

Data Analytics 74

Data Analytics Analytics IoT Data Lake 74

Cloudera

MAY 15, 2019

The Clearsense Platform solves the fundamental data problem by ingesting, organizing, and translating all healthcare stakeholder data into one place, in real-time, and in proper form in any combination for any internal or third-party analytics functions. Check out this list below to see some of them in action: Comcast.

Enterprise 50

Enterprise Data Lake Data mining IoT 50

CIO Business Intelligence

JUNE 29, 2022

Insights hidden in your data are essential for optimizing business operations, finetuning your customer experience, and developing new products — or new lines of business, like predictive maintenance. And as businesses contend with increasingly large amounts of data, the cloud is fast becoming the logical place where analytics work gets done.

Data Lake 111

Data Lake Analytics Data Warehouse Machine Learning 111

AWS Big Data

MAY 30, 2023

Customers have been using data warehousing solutions to perform their traditional analytics tasks. Traditional batch ingestion and processing pipelines that involve operations such as data cleaning and joining with reference data are straightforward to create and cost-efficient to maintain. options(**additional_options).mode("append").save(s3_output_folder)

Data Lake 81

Data Lake Data Analytics Analytics Data Processing 81

AWS Big Data

NOVEMBER 14, 2023

Ten years ago, we launched Amazon Kinesis Data Streams , the first cloud-native serverless streaming data service, to serve as the backbone for companies, to move data across system boundaries, breaking data silos. They just turn on a data stream and start ingesting data.

IoT 55

IoT Data-driven Data Lake Data Strategy 55

CIO Business Intelligence

MAY 24, 2022

Data has always been fundamental to business, but as organisations continue to move to Cloud based environments coupled with advances in technology like streaming and real-time analytics, building a data driven business is one of the keys to success. There are many attributes a data-driven organisation possesses.

Data-driven 82

Data-driven Data Lake Data Warehouse Cost-Benefit 82

AWS Big Data

MAY 16, 2024

As technology continues to evolve, one specific facet of this journey is reaching unprecedented proportions: geospatial data. H3 indexing and related H3 spatial functions are now available for Amazon Redshift spatial analytics. Let’s dive into a use case to see how this can be used to solve an example spatial analysis problem.

Data Warehouse 108

Data Warehouse Visualization Cost-Benefit Optimization 108

Corinium

APRIL 25, 2019

Ahead of the Chief Data Analytics Officers & Influencers, Insurance event we caught up with Dominic Sartorio, Senior Vice President for Products & Development, Protegrity to discuss how the industry is evolving. And more recently, we have also seen innovation with IOT (Internet Of Things).

Insurance 150

Insurance Risk IoT Cost-Benefit 150

Cloudera

AUGUST 9, 2022

Data is integral for both long-term strategy and day-to-day, or even minute-to-minute operation. Everyday, we see the Cloudera Data Platform (CDP) becoming that business-critical analytics platform that customers must have running in an available, reliable, and resilient way. Conclusion.

Data Lake 78

Data Lake Data Warehouse Data-driven IoT 78

AWS Big Data

JUNE 7, 2023

Cargotec captures terabytes of IoT telemetry data from their machinery operated by numerous customers across the globe. This data needs to be ingested into a data lake, transformed, and made available for analytics, machine learning (ML), and visualization.

Metadata 55

Metadata Data Lake Machine Learning Big Data 55

AWS Big Data

JUNE 12, 2023

Organizations across the world are increasingly relying on streaming data, and there is a growing need for real-time data analytics, considering the growing velocity and volume of data being collected. The ETL job continuously consumes data from the Kafka topics, so it’s always up to date with the latest streaming data.

Management 79

Management Metadata Testing Internet of Things 79

AWS Big Data

FEBRUARY 21, 2023

It is a data modeling methodology designed for large-scale data warehouse platforms. What is a data vault? The data vault approach is a method and architectural framework for providing a business with data analytics services to support business intelligence, data warehousing, analytics, and data science needs.

Data Warehouse 65

Data Warehouse Data Lake Cost-Benefit Metadata 65

Alation

APRIL 14, 2022

Data discovery is also critical for data governance , which, when ineffective, can actually hinder organizational growth. And, as organizations progress and grow, “data drift” starts to impact data usage, models, and your business. 8 Critical Analytics Tools for Cloud Environments. Predictive Transformation.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

Sisense

MAY 11, 2021

You can’t talk about data analytics without talking about data modeling. These two functions are nearly inseparable as we move further into a world of analytics that blends sources of varying volume, variety, veracity, and velocity. When it comes to data modeling, function determines form.

Modeling 84

Modeling Big Data IoT Data Warehouse 84

Cloudera

OCTOBER 7, 2021

Those decentralization efforts appeared under different monikers through time, e.g., data marts versus data warehousing implementations (a popular architectural debate in the era of structured data) then enterprise-wide data lakes versus smaller, typically BU-Specific, “data ponds”.

Metadata 124

Metadata Cost-Benefit Enterprise Interactive 124

Jet Global

MAY 9, 2024

A data pipeline is a series of processes that move raw data from one or more sources to one or more destinations, often transforming and processing the data along the way. Data pipelines support data science and business intelligence projects by providing data engineers with high-quality, consistent, and easily accessible data.

Data Lake 52

Data Lake Data Warehouse Business Intelligence Machine Learning 52