AWS Big Data

DECEMBER 13, 2023

In addition to using native managed AWS services that BMS didn’t need to worry about upgrading, BMS was looking to offer an ETL service to non-technical business users that could visually compose data transformation workflows and seamlessly run them on the AWS Glue Apache Spark-based serverless data integration engine.

Metadata 88

Metadata Data Lake Visualization Data Transformation 88

AWS Big Data

DECEMBER 18, 2023

AWS Step Functions is a fully managed visual workflow service that enables you to build complex data processing pipelines involving a diverse set of extract, transform, and load (ETL) technologies such as AWS Glue , Amazon EMR , and Amazon Redshift. The data is then cleansed, transformed, and uploaded to Amazon S3 for further processing.

Metadata 121

Metadata Visualization Data Lake Data-driven 121

AWS Big Data

JANUARY 22, 2024

The company uses AWS Cloud services to build data-driven products and scale engineering best practices. To ensure a sustainable data platform amid growth and profitability phases, their tech teams adopted a decentralized data mesh architecture. The solution Acast implemented is a data mesh, architected on AWS.

Data-driven 85

Data-driven Advertising Metadata Data Architecture 85

AWS Big Data

JUNE 12, 2024

In today’s data-driven world, organizations are continually confronted with the task of managing extensive volumes of data securely and efficiently. A common use case that we see amongst customers is to search and visualize data. A common use case that we see amongst customers is to search and visualize data.

Dashboards 91

Dashboards Visualization Sales IoT 91

AWS Big Data

MAY 31, 2024

This encompasses tasks such as integrating diverse data from various sources with distinct formats and structures, optimizing the user experience for performance and security, providing multilingual support, and optimizing for cost, operations, and reliability.

Metadata 107

Metadata Management Testing Data-driven 107

Smart Data Collective

APRIL 14, 2021

Advancement in big data technology has made the world of business even more competitive. The proper use of business intelligence and analytical data is what drives big brands in a competitive market. Business intelligence tools can include data warehousing, data visualizations, dashboards, and reporting.

Business Intelligence 133

Business Intelligence Dashboards Visualization Big Data 133

erwin

APRIL 2, 2021

Organizations are managing more data than ever. With more companies increasingly migrating their data to the cloud to ensure availability and scalability, the risks associated with data management and protection also are growing. Data Security Starts with Data Governance. Who is authorized to use it and how?

Data Governance 106

Data Governance Cost-Benefit Risk Metadata 106

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

Data Lake 87

Data Lake Analytics Snapshot Optimization 87

AWS Big Data

DECEMBER 21, 2023

This is a guest post co-written by Alex Naumov, Principal Data Architect at smava. smava believes in and takes advantage of data-driven decisions in order to become the market leader. smava believes in and takes advantage of data-driven decisions in order to become the market leader.

Data Lake 89

Data Lake Data Warehouse Data-driven B2B 89

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 68

Data Strategy Strategy Data Warehouse Prescriptive Analytics 68

AWS Big Data

JUNE 12, 2024

Swisscom’s Data, Analytics, and AI division is building a One Data Platform (ODP) solution that will enable every Swisscom employee, process, and product to benefit from the massive value of Swisscom’s data. The following high-level architecture diagram shows ODP with different layers of the modern data architecture.

Data Architecture 92

Data Architecture Cost-Benefit Experimentation Management 92

AWS Big Data

JANUARY 27, 2023

To build a data-driven business, it is important to democratize enterprise data assets in a data catalog. With a unified data catalog, you can quickly search datasets and figure out data schema, data format, and location. For metadata read/write, Flink has the catalog interface.

Data Lake 62

Data Lake Metadata Business Analysis Data-driven 62

AWS Big Data

MAY 16, 2024

Apache Airflow is a popular platform for enterprises looking to orchestrate complex data pipelines and workflows. In this post, we’re excited to introduce two new features that address common customer challenges and unlock new possibilities for building robust, scalable, and flexible data orchestration solutions using Amazon MWAA.

Testing 89

Testing Interactive Metrics Management 89

AWS Big Data

MARCH 7, 2024

Organizations often need to manage a high volume of data that is growing at an extraordinary rate. At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. We think of this concept as inside-out data movement. Example Corp.

Data Lake 113

Data Lake Analytics Dashboards Metrics 113

Cloudera

MAY 18, 2021

Second, since IaaS deployments replicated the on-premises HDFS storage model, they resulted in the same data replication overhead in the cloud (typical 3x), something that could have mostly been avoided by leveraging modern object store. that optimizes autoscaling for compute resources compared to the efficiency of VM-based scaling. .

Cost-Benefit 86

Cost-Benefit Data-driven Data Warehouse Machine Learning 86

AWS Big Data

NOVEMBER 22, 2023

Today, we’re making available a new capability of AWS Glue Data Catalog that allows generating column-level statistics for AWS Glue tables. Data lakes are designed for storing vast amounts of raw, unstructured, or semi-structured data at a low cost, and organizations share those datasets across multiple departments and teams.

Statistics 101

Statistics Data Lake Optimization Data-driven 101

Domino Data Lab

JUNE 2, 2019

Co-chair Paco Nathan provides highlights of Rev 2 , a data science leaders summit. We held Rev 2 May 23-24 in NYC, as the place where “data science leaders and their teams come to learn from each other.” Nick Elprin, CEO and co-founder of Domino Data Lab. First item on our checklist: did Rev 2 address how to lead data teams?

Data-driven 110

Data-driven Data Science Machine Learning Modeling 110

AWS Big Data

APRIL 26, 2024

To enable your workforce users for analytics with fine-grained data access controls and audit data access, you might have to create multiple AWS Identity and Access Management (IAM) roles with different data permissions and map the workforce users to one of those roles. We use Okta as the IdP for this demonstration.

Analytics 95

Analytics Data Lake Management Enterprise 95

AWS Big Data

APRIL 28, 2023

This is the second post of a three-part series detailing how Novo Nordisk , a large pharmaceutical enterprise, partnered with AWS Professional Services to build a scalable and secure data and analytics platform. The third post will show how end-users can consume data from their tool of choice, without compromising data governance.

Data Governance 65

Data Governance Management Data-driven Data Lake 65

Alation

FEBRUARY 13, 2020

This article is based on a podcast Ron Powell conducted with Sharon Graves, Enterprise Data and BI Tools Evangelist for GoDaddy, about data curation, data stewardship, and data catalogs. His focus is on business intelligence, analytics, big data, and data warehousing. What did that involve?

Digital Transformation 52

Digital Transformation Data-driven Business Intelligence Big Data 52

Andrew White

JANUARY 11, 2021

On January 4th I had the pleasure of hosting a webinar. It was titled, The Gartner 2021 Leadership Vision for Data & Analytics Leaders. This was for the Chief Data Officer, or head of data and analytics. The fill report is here: Leadership Vision for 2021: Data and Analytics. Ooo good question.

Data Analytics 52

Data Analytics Analytics Data-driven Finance 52

Alation

JANUARY 17, 2023

Chances are, you’ve heard of the term “modern data stack” before. In this article, I will explain the modern data stack in detail, list some benefits, and discuss what the future holds. What Is the Modern Data Stack? It is known to have benefits in handling data due to its robustness, speed, and scalability.

Data Warehouse 52

Data Warehouse Cost-Benefit Data Transformation Data Science 52

Jet Global

MAY 1, 2023

By leveraging data analysis to solve high-value business problems, they will become more efficient. This is in contrast to traditional BI, which extracts insight from data outside of the app. that gathers data from many sources. These tools prep that data for analysis and then provide reporting on it from a central viewpoint.

Analytics 52

Analytics Cost-Benefit Visualization Dashboards 52