AWS Big Data

OCTOBER 23, 2023

At AWS re:Invent 2022, Amazon Athena launched support for Apache Spark. Before you run these workloads, most customers run SQL queries to interactively extract, filter, join, and aggregate data into a shape that can be used for decision-making, model training, or inference. An Athena Spark workgroup configured for use.

Data Lake 101

Data Lake Visualization Optimization Interactive 101

AWS Big Data

APRIL 20, 2023

In a modern data architecture, unified analytics enable you to access the data you need, whether it’s stored in a data lake or a data warehouse. AWS Glue provides an extensible architecture that enables users with different data processing use cases, and works well with Amazon Redshift.

Visualization 75

Visualization Data Warehouse Big Data Data Lake 75

AWS Big Data

JANUARY 18, 2024

AWS Lake Formation and the AWS Glue Data Catalog form an integral part of a data governance solution for data lakes built on Amazon Simple Storage Service (Amazon S3) with multiple AWS analytics services integrating with them. In 2022 , we talked about the enhancements we had done to these services.

Data Lake 89

Data Lake Metadata Data Governance Statistics 89

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In 2022, AWS commissioned a study conducted by the American Productivity and Quality Center (APQC) to quantify the Business Value of Customer 360.

Data Strategy 69

Data Strategy Strategy Data Warehouse Prescriptive Analytics 69

AWS Big Data

APRIL 25, 2024

In the era of data, organizations are increasingly using data lakes to store and analyze vast amounts of structured and unstructured data. Data lakes provide a centralized repository for data from various sources, enabling organizations to unlock valuable insights and drive data-driven decision-making.

Optimization 67

Optimization Data Lake Cost-Benefit Reporting 67

AWS Big Data

MAY 1, 2024

To achieve data-driven management, we built OneData, a data utilization platform used in the four global AWS Regions, which started operation in April 2022. The platform consists of approximately 370 dashboards, 360 tables registered in the data catalog, and 40 linked systems.

Dashboards 111

Dashboards Data-driven Publishing Cost-Benefit 111

AWS Big Data

DECEMBER 21, 2023

To bring their customers the best deals and user experience, smava follows the modern data architecture principles with a data lake as a scalable, durable data store and purpose-built data stores for analytical processing and data consumption. This is the Data Mart stage.

Data Lake 88

Data Lake Data Warehouse Data-driven B2B 88

AWS Big Data

JUNE 21, 2023

When setting out to build a data warehouse, it’s a common pattern to have a data lake as the source of the data warehouse. The data lake in this context serves a number of important functions: It acts as a central source for multiple applications, not just exclusively for data warehousing purposes.

Data Warehouse 78

Data Warehouse Data Lake OLAP Cost-Benefit 78

AWS Big Data

MARCH 17, 2023

TalentReef was acquired by Mitratech in August 2022 with the goal to combine TalentReef’s best-in-class systems with Mitratech’s expertise, technology, and global platform to ensure their customers’ hiring needs are serviced better and faster than anyone else in the industry.

Dashboards 52

Dashboards IT Data Lake Visualization 52

AWS Big Data

JUNE 28, 2023

QuickSight makes it incredibly simple and intuitive to get to answers with Amazon QuickSight Q , which allows users to ask business questions about their data in natural language and receive answers quickly through data visualizations. This provides a flexible way to ingest data while avoiding complex ETL pipelines.

Analytics 67

Analytics Data Warehouse Data Lake Data-driven 67

IBM Big Data Hub

APRIL 27, 2022

With data ownership decentralization, data owners can create data products for their respective domains, meaning data consumers, both data scientist and business users, can use a combination of these data products for data analytics and data science. 3 March 2022. 11 May 2021. .

Management 88

Management Metadata Data Architecture Data Lake 88

AWS Big Data

APRIL 5, 2023

In this post, we share how Showpad used QuickSight to streamline data and insights access across teams and customers. Showpad migrated over 70 dashboards with over 1,000 visuals. The company also used the opportunity to reimagine its data pipeline and architecture.

Dashboards 52

Dashboards Reporting Cost-Benefit Visualization 52

BizAcuity

MAY 10, 2022

The cloud market is well on track to reach the expected $495 billion dollar mark by the end of 2022. 2007: Amazon launches SimpleDB, a non-relational (NoSQL) database that allows businesses to cheaply process vast amounts of data with minimal effort. They now have a disruptive data management solution to offer to its client base.

Data-driven 52

Data-driven IoT Unstructured Data Data Lake 52

AWS Big Data

MARCH 3, 2023

Building data lakes from continuously changing transactional data of databases and keeping data lakes up to date is a complex task and can be an operational challenge. You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes.

Data Lake 80

Data Lake Dashboards Metrics Metadata 80

IBM Big Data Hub

OCTOBER 4, 2023

Why does AI need an open data lakehouse architecture? from 2022 to 2026. Another IDC study showed that while 2/3 of respondents reported using AI-driven data analytics, most reported that less than half of the data under management is available for this type of analytics. All of this supports the use of AI.

Data Lake 86

Data Lake Metadata Cost-Benefit Data Warehouse 86

CIO Business Intelligence

AUGUST 18, 2022

Previously, Walgreens was attempting to perform that task with its data lake but faced two significant obstacles: cost and time. Those challenges are well-known to many organizations as they have sought to obtain analytical knowledge from their vast amounts of data. Lakehouses redeem the failures of some data lakes.

Data Lake 140

Data Lake Data Warehouse Unstructured Data Business Intelligence 140

Smart Data Collective

OCTOBER 17, 2022

Big data is shaping our world in countless ways. Data powers everything we do. Exactly why, the systems have to ensure adequate, accurate and most importantly, consistent data flow between different systems. A point of data entry in a given pipeline. The destination is decided by the use case of the data pipeline.

Data Warehouse 131

Data Warehouse Data Lake Visualization Big Data 131

IBM Big Data Hub

OCTOBER 12, 2023

They’re built on machine learning algorithms that create outputs based on an organization’s data or other third-party big data sources. Sometimes, these outputs are biased because the data used to train the model was incomplete or inaccurate in some way. Learn more about IBM watsonx 1.

Cost-Benefit 83

Cost-Benefit Metadata Data Governance Modeling 83