AWS Big Data

NOVEMBER 9, 2023

Building a data platform involves various approaches, each with its unique blend of complexities and solutions. In this post, we delve into a case study for a retail use case, exploring how the Data Build Tool (dbt) was used effectively within an AWS environment to build a high-performing, efficient, and modern data platform.

Data Warehouse 103

Data Warehouse Testing Data Quality Reporting 103

AWS Big Data

MARCH 8, 2024

Unsupervised machine learning analytics has emerged as a powerful tool for anomaly detection in today’s data-rich landscape, especially with the growing volume of machine-generated data. In-stream anomaly detection offers real-time insights into data anomalies, enabling proactive response.

Data Processing 97

Data Processing Risk Management Machine Learning Big Data 97

Rocket-Powered Data Science

JUNE 17, 2022

One of the first major attractions for me to attend this event is found in the primary descriptor of the Splunk Platform — it is appropriately called the Splunk Observability Cloud, which includes an impressive suite of Observability and Monitoring products and services. I recently attended the Splunk.conf22 conference. is here, now!

Machine Learning 237

Machine Learning Recreation/Entertainment Risk Business Objectives 237

AWS Big Data

OCTOBER 11, 2023

Under the Transparency in Coverage (TCR) rule , hospitals and payors to publish their pricing data in a machine-readable format. The data in the machine-readable files can provide valuable insights to understand the true cost of healthcare services and compare prices and quality across hospitals.

Visualization 94

Visualization Dashboards Data-driven Gap analysis 94

AWS Big Data

FEBRUARY 12, 2024

Objective Gupshup wanted to build a messaging analytics platform that provided: Build a platform to get detailed insights, data, and reports about WhatsApp/SMS campaigns and track the success of every text message sent by the end customers. Easily gain insight into trends, delivery rates, and speed.

Data Warehouse 98

Data Warehouse Analytics Snapshot Cost-Benefit 98

AWS Big Data

MARCH 27, 2024

Amazon Redshift is a fast, scalable, and fully managed cloud data warehouse that allows you to process and run your complex SQL analytics workloads on structured and semi-structured data. The scope should contain inputs and data points on the current architecture as well as the target architecture.

Testing 98

Testing Data Warehouse Metrics Cost-Benefit 98

AWS Big Data

APRIL 12, 2024

Today’s fast-paced world demands timely insights and decisions, which is driving the importance of streaming data. Streaming data refers to data that is continuously generated from a variety of sources. Snowflake offers two options to bring streaming data into its platform: Snowpipe and Snowflake Snowpipe Streaming.

Data Architecture 90

Data Architecture IoT Internet of Things Recreation/Entertainment 90

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 67

Data Strategy Strategy Data Warehouse Prescriptive Analytics 67

AWS Big Data

MARCH 13, 2024

For building any generative AI application, enriching the large language models (LLMs) with new data is imperative. For ingesting these external data sources, Vector databases have evolved, which can store vector embeddings of the data source and allow for similarity searches.

Data Processing 109

Data Processing Dashboards Machine Learning Management 109

AWS Big Data

OCTOBER 11, 2023

Organizations with legacy, on-premises, near-real-time analytics solutions typically rely on self-managed relational databases as their data store for analytics workloads. Near-real-time streaming analytics captures the value of operational data and metrics to provide new insights to create business opportunities.

Management 103

Management Metadata Analytics Dashboards 103

AWS Big Data

NOVEMBER 28, 2023

As customers become more data driven and use data as a source of competitive advantage, they want to easily run analytics on their data to better understand their core business drivers to grow sales, reduce costs, and optimize their businesses. ETL is the process data engineers use to combine data from different sources.

Data Warehouse 90

Data Warehouse Data-driven Machine Learning B2B 90

AWS Big Data

FEBRUARY 20, 2024

You can ingest and integrate data from multiple Internet of Things (IoT) sensors to get insights. However, you may have to integrate data from multiple IoT sensor devices to derive analytics like equipment health information from all the sensors based on common data elements.

IoT 92

IoT Analytics Prescriptive Analytics Internet of Things 92

AWS Big Data

APRIL 26, 2023

Additionally, this forecasting system needs to provide data enrichment steps including byproducts, serve as the master data around the semiconductor management, and enable further use cases at the BMW Group. To enable this use case, we used the BMW Group’s cloud-native data platform called the Cloud Data Hub.

Manufacturing 120

Manufacturing Forecasting Data Lake Big Data 120

AWS Big Data

MARCH 29, 2024

Real-time data streaming and event processing present scalability and management challenges. AWS offers a broad selection of managed real-time data streaming services to effortlessly run these workloads at any scale. In the following sections, Nexthink introduces their product and the need for scalability.

Cost-Benefit 89

Cost-Benefit Data-driven Metrics Management 89

AWS Big Data

MARCH 11, 2024

Amazon Redshift is a fully managed, scalable cloud data warehouse that accelerates your time to insights with fast, straightforward, and secure analytics at scale. You can run and scale analytics in seconds on all your data, without having to manage your data warehouse infrastructure.

Analytics 65

Analytics Data Warehouse Optimization Metrics 65

AWS Big Data

NOVEMBER 29, 2023

In 2013, Amazon Web Services revolutionized the data warehousing industry by launching Amazon Redshift , the first fully-managed, petabyte-scale, enterprise-grade cloud data warehouse. Amazon Redshift made it simple and cost-effective to efficiently analyze large volumes of data using existing business intelligence tools.

Data Warehouse 99

Data Warehouse Data Lake Analytics Machine Learning 99

AWS Big Data

MARCH 29, 2024

However, to analyze trends over time, aggregate from different dimensions, and share insights across the organization, a purpose-built business intelligence (BI) tool like Amazon QuickSight may be more effective for your business. QuickSight makes it straightforward for business users to visualize data in interactive dashboards and reports.

Metrics 103

Metrics Visualization Dashboards Interactive 103

AWS Big Data

AUGUST 23, 2023

OpenSearch Service provides two configuration options to deploy and operate OpenSearch at scale in the cloud. With managed domains, you can use advanced capabilities at no extra cost such as cross-cluster search, cross-cluster replication, anomaly detection, semantic search, security analytics, and more.

Snapshot 93

Snapshot Dashboards Visualization Metrics 93

Timo Elliott

JANUARY 6, 2022

Like the proverbial man looking for his keys under the streetlight , when it comes to enterprise data, if you only look at where the light is already shining, you can end up missing a lot. Remember that dark data is the data you have but don’t understand. So how do you find your dark data? Analyze your metadata.

IT 133

IT Metadata Data-driven Data Governance 133

AWS Big Data

NOVEMBER 8, 2023

re:Invent is a learning conference organized by AWS for the global cloud computing community. It’s a great opportunity to come together with cloud enthusiasts from around the world to hear about the latest cloud industry innovations, meet with AWS experts, have fun, and build connections. Reserve your seat now!

Data-driven 87

Data-driven Data Lake Machine Learning Cost-Benefit 87

AWS Big Data

NOVEMBER 15, 2023

BMW Group uses 4,500 AWS Cloud accounts across the entire organization but is faced with the challenge of reducing unnecessary costs, optimizing spend, and having a central place to monitor costs. The ultimate goal is to raise awareness of cloud efficiency and optimize cloud utilization in a cost-effective and sustainable manner.

Dashboards 93

Dashboards Analytics Metadata Optimization 93

FineReport

APRIL 21, 2024

In today’s data-driven landscape, businesses are constantly seeking innovative solutions to harness the power of analytics effectively. Embedded BI tools have emerged as a transformative force, seamlessly integrating analytical capabilities directly into existing software applications.

Dashboards 52

Dashboards Visualization Interactive Business Intelligence 52

AWS Big Data

MARCH 25, 2024

FMs are multimodal; they work with different data types such as text, video, audio, and images. Large language models (LLMs) are a type of FM and are pre-trained on vast amounts of text data and typically have application uses such as text generation, intelligent chatbots, or summarization.

Data Lake 88

Data Lake Unstructured Data Management Modeling 88

AWS Big Data

OCTOBER 24, 2023

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud, providing up to five times better price-performance than any other cloud data warehouse, with performance innovation out of the box at no additional cost to you. Note all times are recorded in microseconds.

Metrics 83

Metrics Statistics Data Warehouse Cost-Benefit 83

AWS Big Data

DECEMBER 13, 2023

Data loses value over time. Traditionally, customers used batch-based approaches for data movement from operational systems to analytical systems. A batch-based approach can introduce latency in data movement and reduce the value of data for analytics. Batch load can run once or several times a day.

Data Warehouse 96

Data Warehouse Snapshot Data Processing Management 96

AWS Big Data

JULY 27, 2023

Amazon Redshift is a fully managed, scalable cloud data warehouse that accelerates your time to insights with fast, easy, and secure analytics at scale. Tens of thousands of customers rely on Amazon Redshift to analyze exabytes of data and run complex analytical queries, making it the widely used cloud data warehouse.

Data Warehouse 82

Data Warehouse Analytics Metadata Dashboards 82

Cloudera

JANUARY 30, 2024

With the ability of manufacturers to store a huge volume of historical data, AI can be applied in general business areas of any industry, like developing recommendations for marketing, supply chain optimization, and new product development. With AI, it can even prescribe the appropriate action that needs to be taken and when.

Manufacturing 78

Manufacturing Contextual Data IoT Digital Transformation 78

CIO Business Intelligence

APRIL 12, 2023

By George Trujillo, Principal Data Strategist, DataStax I recently had a conversation with a senior executive who had just landed at a new organization. He had been trying to gather new data insights but was frustrated at how long it was taking. Sound familiar?) It isn’t easy.

Machine Learning 132

Machine Learning Cost-Benefit Data-driven Strategy 132

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. Orca Security is an industry-leading Cloud Security Platform that identifies, prioritizes, and remediates security risks and compliance issues across your AWS Cloud estate.

Data Lake 86

Data Lake Analytics Snapshot Optimization 86

IBM Big Data Hub

MARCH 21, 2024

Artificial intelligence (AI) is revolutionizing industries by enabling advanced analytics, automation and personalized experiences. Cloud platforms and container orchestration technologies provide scalable, elastic resources that dynamically allocate compute, storage and networking resources based on workload requirements.

Optimization 66

Optimization Software Data-driven Consulting 66

AWS Big Data

JULY 13, 2023

This is a guest post authored by Kris Bliesner and Mike Brown from Vega Cloud. Vega Cloud is a premier member of the FinOps Foundation, a program by Linux Foundation supporting FinOps practitioners on cloud financial management best practices.

Cost-Benefit 76

Cost-Benefit Dashboards Optimization Visualization 76

CIO Business Intelligence

FEBRUARY 14, 2023

By George Trujillo, Principal Data Strategist, DataStax Increased operational efficiencies at airports. To succeed with real-time AI, data ecosystems need to excel at handling fast-moving streams of events, operational data, and machine learning models to leverage insights and automate decision-making.

Data Strategy 105

Data Strategy Strategy Machine Learning Data-driven 105

AWS Big Data

AUGUST 3, 2023

With the rapid growth of technology, more and more data volume is coming in many different formats—structured, semi-structured, and unstructured. Data analytics on operational data at near-real time is becoming a common need. a new version of AWS Glue that accelerates data integration workloads in AWS.

Data Lake 79

Data Lake Visualization Dashboards Insurance 79

AWS Big Data

AUGUST 9, 2023

The combination of a data lake in a serverless paradigm brings significant cost and performance benefits. By monitoring application logs, you can gain insights into job execution, troubleshoot issues promptly to ensure the overall health and reliability of data pipelines.

Data Lake 86

Data Lake Metrics Testing Cost-Benefit 86

CIO Business Intelligence

MAY 12, 2022

What are predictive analytics tools? Predictive analytics tools blend artificial intelligence and business reporting. The quality of predictions depends primarily on the data that goes into the system — the old slogan from the mainframe years, “garbage in, garbage out”, still holds today. Top predictive analytics tools compared.

Predictive Analytics 136

Predictive Analytics Analytics Statistics Machine Learning 136

AWS Big Data

FEBRUARY 29, 2024

Data is your generative AI differentiator, and a successful generative AI implementation depends on a robust data strategy incorporating a comprehensive data governance approach. Data governance is a critical building block across all these approaches, and we see two emerging areas of focus.

Data Governance 93

Data Governance Unstructured Data Metadata Data Lake 93

IBM Big Data Hub

JULY 27, 2022

Today, most enterprises use services from more than one Cloud Service Provider (CSP). Moreover, there are often duplicate events due to full-stack level observability and these events result in data silos. How could we reimagine cloud service management and operations with AI? Predictive analytics to show what will happen next.

Prescriptive Analytics 93

Prescriptive Analytics Descriptive Analytics Data-driven Cost-Benefit 93