AWS Big Data

JUNE 2, 2023

Amazon Redshift is a widely used, fully managed, petabyte-scale cloud data warehouse. Tens of thousands of customers use Amazon Redshift to process exabytes of data every day to power their analytic workloads. This pre-built solution scales to load data in parallel using input parameters.

Metadata 108

Metadata Data Warehouse Big Data Testing 108

AWS Big Data

APRIL 3, 2023

Tens of thousands of customers run business-critical workloads on Amazon Redshift , AWS’s fast, petabyte-scale cloud data warehouse delivering the best price-performance. With Amazon Redshift, you can query data across your data warehouse, operational data stores, and data lake using standard SQL.

Data Warehouse 96

Data Warehouse Testing Data Lake Data-driven 96

datapine

SEPTEMBER 29, 2022

1) What Is Data Quality Management? 4) Data Quality Best Practices. 5) How Do You Measure Data Quality? 6) Data Quality Metrics Examples. 7) Data Quality Control: Use Case. 8) The Consequences Of Bad Data Quality. 9) 3 Sources Of Low-Quality Data. 10) Data Quality Solutions: Key Attributes.

Data Quality 241

Data Quality Metrics Data-driven Management 241

AWS Big Data

NOVEMBER 22, 2023

Today, we’re making available a new capability of AWS Glue Data Catalog that allows generating column-level statistics for AWS Glue tables. Data lakes are designed for storing vast amounts of raw, unstructured, or semi-structured data at a low cost, and organizations share those datasets across multiple departments and teams.

Statistics 99

Statistics Data Lake Optimization Data-driven 99

AWS Big Data

JUNE 29, 2023

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud that delivers powerful and secure insights on all your data with the best price-performance. With Amazon Redshift, you can analyze your data to derive holistic insights about your business and your customers.

Data Warehouse 59

Data Warehouse Dashboards Testing Visualization 59

AWS Big Data

FEBRUARY 9, 2023

Customers across industries seek meaningful insights from the data captured in their Customer Relationship Management (CRM) systems. To achieve this, they combine their CRM data with a wealth of information already available in their data warehouse, enterprise systems, or other software as a service (SaaS) applications.

Data Warehouse 74

Data Warehouse Data-driven Snapshot Testing 74

DataKitchen

NOVEMBER 4, 2021

Data organizations often have a mix of centralized and decentralized activity. DataOps concerns itself with the complex flow of data across teams, data centers and organizational boundaries. It expands beyond tools and data architecture and views the data organization from the perspective of its processes and workflows.

Data Processing 246

Data Processing Data Lake Cost-Benefit Testing 246

Sisense

APRIL 17, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways Data Teams are tackling the challenges of this new world to help their companies and their customers thrive. What is a materialized view, anyway?

Data Warehouse 90

Data Warehouse Visualization Statistics Machine Learning 90

Sisense

JULY 8, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways Data Teams are tackling the challenges of this new world to help their companies and their customers thrive.

Data Warehouse 90

Data Warehouse Data Lake Data-driven Cost-Benefit 90

AWS Big Data

OCTOBER 20, 2023

Today, we are pleased to announce new AWS Glue connectors for Azure Blob Storage and Azure Data Lake Storage that allow you to move data bi-directionally between Azure Blob Storage, Azure Data Lake Storage, and Amazon Simple Storage Service (Amazon S3).

Data Lake 82

Data Lake Big Data Consulting Data Warehouse 82

AWS Big Data

JANUARY 17, 2024

This allows you to simplify security and governance over transactional data lakes by providing access controls at table-, column-, and row-level permissions with your Apache Spark jobs. Many large enterprise companies seek to use their transactional data lake to gain insights and improve decision-making.

Data Lake 91

Data Lake Snapshot Big Data Data-driven 91

AWS Big Data

APRIL 20, 2023

Customers use Amazon Redshift to run their business-critical analytics on petabytes of structured and semi-structured data. Apache Spark is a popular framework that you can use to build applications for use cases such as ETL (extract, transform, and load), interactive analytics, and machine learning (ML).

Data Lake 75

Data Lake Data Warehouse Sales Data-driven 75

CIO Business Intelligence

SEPTEMBER 8, 2022

The headlines read “Artificial Intelligence (AI) will completely transform your business.” This creates a flywheel we call The Data Network Effect, where you acquire more data, which helps create better algorithms, which drives better engagement, ultimately leading to happier customers, which then generates more data, and so on, and so on.

Machine Learning 115

Machine Learning Cost-Benefit Data-driven Digital Transformation 115

AWS Big Data

MARCH 2, 2023

Apache Iceberg is an open table format for very large analytic datasets, which captures metadata information on the state of datasets as they evolve and change over time. It adds tables to compute engines including Spark, Trino, PrestoDB, Flink, and Hive using a high-performance table format that works just like a SQL table.

Data Lake 116

Data Lake Data Processing Metadata Snapshot 116

AWS Big Data

MAY 25, 2023

Data transformation plays a pivotal role in providing the necessary data insights for businesses in any organization, small and large. Picture a scenario where you, the VP of Data and Analytics, are in charge of your data and analytics environments and workloads running on AWS where you manage a team of data engineers and analysts.

Reporting 68

Reporting Metrics Optimization Data Lake 68

AWS Big Data

JUNE 6, 2023

Data is the lifeblood of modern businesses. In today’s data-driven world, companies rely on data to make informed decisions, gain a competitive edge, and provide exceptional customer experiences. However, not all data is created equal. AWS Glue Data Quality measures and monitors the quality of your dataset.

Data Quality 67

Data Quality Data Lake Visualization Data-driven 67

AWS Big Data

JULY 31, 2023

Data has become an integral part of most companies, and the complexity of data processing is increasing rapidly with the exponential growth in the amount and variety of data. AWS Glue is a serverless data integration and ETL service with the ability to scale on demand.

Sales 52

Sales Data Warehouse Visualization Testing 52

AWS Big Data

JUNE 23, 2023

This blog post is co-written with Ori Nakar from Imperva. Events and many other security data types are stored in Imperva’s Threat Research Multi-Region data lake. Imperva harnesses data to improve their business outcomes. As part of their solution, they are using Amazon QuickSight to unlock insights from their data.

Data Lake 68

Data Lake Cost-Benefit Dashboards Data Warehouse 68

Sisense

JANUARY 13, 2021

During that time, they’ve faced challenges both expected (data volumes growing as the business grew) and not (a UK-wide lockdown, in addition to various temporary store closures). The problem: Too much data, too little insight. Pet Family had used various BI platforms over the years, but were not getting the results they wanted.

Sales 95

Sales Dashboards Business Intelligence Cost-Benefit 95

Sisense

JANUARY 13, 2021

During that time, it has faced challenges both expected (data volumes growing as the business grew) and not (a U.K.-wide Getting smarter about its data and how it is used has allowed Pets Corner to be more agile and make the right decisions at the right times to thrive in challenging conditions. How YourDMS helped.

Sales 59

Sales Dashboards Management Finance 59

Sisense

SEPTEMBER 3, 2020

We live in a constantly-evolving world of data. That means that jobs in data big data and data analytics abound. The wide variety of data titles can be dizzying and confusing! The growth in the range of data job titles is a testament to the value that these experts bring to their organizations.

Statistics 97

Statistics Metrics Visualization Finance 97

datapine

JANUARY 18, 2023

No matter what role or industry you work in, chances are that you have been faced with the task of generating a tedious report to show your progress or performance. But, with so many types of reports used on a daily basis, how can you know when to use them effectively? Let’s get started with a brief report definition.

Reporting 201

Reporting Metrics Dashboards Visualization 201

AWS Big Data

OCTOBER 27, 2023

Data integration is the foundation of robust data analytics. It encompasses the discovery, preparation, and composition of data from diverse sources. In the modern data landscape, accessing, integrating, and transforming data from diverse sources is a vital process for data-driven decision-making.

Analytics 94

Analytics Visualization Data Integration Cost-Benefit 94

datapine

MAY 29, 2019

That’s a fact in today’s competitive business environment that requires agile access to a data storage warehouse , organized in a manner that will improve business performance, deliver fast, accurate, and relevant data insights. One of the BI architecture components is data warehousing. Data integration.

Business Intelligence 196

Business Intelligence Data Warehouse Dashboards Visualization 196

Occam's Razor

APRIL 25, 2011

" A mighty term, used in a very unmighty sense here, but I hope it makes you sit up and take note. " A mighty term, used in a very unmighty sense here, but I hope it makes you sit up and take note. How many of these things is your company currently doing. ideas from your kids or neighbor.

Marketing 126

Marketing Measurement Metrics Testing 126

AWS Big Data

MARCH 21, 2024

In this post, we provide step-by-step guidance on how to get started with near real-time operational analytics using this feature. This post is a continuation of the zero-ETL series that started with Getting started guide for near-real time operational analytics using Amazon Aurora zero-ETL integration with Amazon Redshift.

Data Warehouse 86

Data Warehouse Metrics Optimization Statistics 86

AWS Big Data

OCTOBER 31, 2023

This blog post is co-written with James Sun from Snowflake. Customers rely on data from different sources such as mobile applications, clickstream events from websites, historical data, and more to deduce meaningful patterns to optimize their products, services, and processes.

Data Processing 88

Data Processing Management Publishing Testing 88

Domino Data Lab

JULY 22, 2019

Paco Nathan presented, “Data Science, Past & Future” , at Rev. This blog post provides a concise session summary, a video, and a written transcript. data science’s emergence as an interdisciplinary field – from industry, not academia. You’ve seen Jon up here, too, doing fantastic MC-ing. Transcript.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

AWS Big Data

JULY 21, 2023

Data-driven organizations treat data as an asset and use it across different lines of business (LOBs) to drive timely insights and better business decisions. This leads to having data across many instances of data warehouses and data lakes using a modern data architecture in separate AWS accounts.

Data Lake 85

Data Lake Data Warehouse Marketing Management 85

AWS Big Data

NOVEMBER 22, 2023

Apache Hudi is an open table format that brings database and data warehouse capabilities to data lakes. Apache Hudi helps data engineers manage complex challenges, such as managing continuously evolving datasets with transactions while maintaining query performance.

Data Lake 91

Data Lake Snapshot Metadata Optimization 91

Alation

JANUARY 17, 2023

Chances are, you’ve heard of the term “modern data stack” before. But you may not actually know what it really meant because many people use it as a buzzword! In actual fact, it isn’t all that confusing at all, and understanding what it means can have huge benefits for your organization. What Is the Modern Data Stack?

Data Warehouse 52

Data Warehouse Cost-Benefit Data Transformation Business Intelligence 52

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. In AWS ProServe-led customer engagements, the use cases we work on usually come with technical complexity and scalability requirements.

Data Lake 89

Data Lake Data Processing Metadata Snapshot 89

AWS Big Data

JULY 12, 2023

This blog post is co-written with Zygimantas Koncius from Etleap. Organizations use their data to extract valuable insights and drive informed business decisions. The result is robust and flexible data products with high scalability and best-in-class query performance.

Data Warehouse 52

Data Warehouse Modeling Dashboards Data Lake 52

IBM Big Data Hub

DECEMBER 7, 2023

Online analytical processing (OLAP) database systems and artificial intelligence (AI) complement each other and can help enhance data analysis and decision-making when used in tandem. Early OLAP systems were separate, specialized databases with unique data storage structures and query languages.

OLAP 63

OLAP Slice and Dice Cost-Benefit Data Warehouse 63

AWS Big Data

JULY 19, 2023

Amazon Redshift is a fully managed and petabyte-scale cloud data warehouse that is used by tens of thousands of customers to process exabytes of data every day to power their analytics workload. Overall, the post will give you a clear understanding of how to use dimensional modeling in Amazon Redshift.

Modeling 68

Modeling Sales Data Warehouse Snapshot 68

AWS Big Data

MARCH 9, 2023

Thousands of customers rely on Amazon Redshift to build data warehouses to accelerate time to insights with fast, simple, and secure analytics at scale and analyze data from terabytes to petabytes by running complex analytical queries. The star schema is a popular data model for building data marts.

Slice and Dice 80

Slice and Dice Data Warehouse Metrics Metadata 80

AWS Big Data

MARCH 28, 2023

In a data warehouse, a dimension is a structure that categorizes facts and measures in order to enable users to answer business questions. A slowly changing dimension (SCD) is a data warehousing concept that contains relatively static data that can change slowly over a period of time.

Data Lake 69

Data Lake Testing Snapshot Sales 69