AWS Big Data

FEBRUARY 29, 2024

Data is your generative AI differentiator, and a successful generative AI implementation depends on a robust data strategy incorporating a comprehensive data governance approach. Data governance is a critical building block across all these approaches, and we see two emerging areas of focus.

Data Governance 92

Data Governance Unstructured Data Metadata Data Lake 92

AWS Big Data

JUNE 6, 2023

Data is the lifeblood of modern businesses. In today’s data-driven world, companies rely on data to make informed decisions, gain a competitive edge, and provide exceptional customer experiences. However, not all data is created equal. AWS Glue Data Quality measures and monitors the quality of your dataset.

Data Quality 66

Data Quality Data Lake Visualization Data-driven 66

AWS Big Data

MARCH 26, 2024

We are delighted to announce the release of the Data Analytics Lens. The lens consists of a lens whitepaper and an AWS-created lens available in the Lens Catalog of the AWS Well-Architected Tool. The AWS Well-Architected Framework provides a consistent approach to evaluate architectures and implement scalable designs.

Data Analytics 56

Data Analytics Analytics Big Data Data Lake 56

Octopai

OCTOBER 5, 2021

Your CFO finally gave the okay to purchase data catalog software. How will you choose the best data catalog software for your company? Does it support automatic harvesting from your other data/BI software? Check the data catalog’s ability for ease of integration with each tool in your BI environment.

Business Intelligence 84

Business Intelligence Software Cost-Benefit Metadata 84

Octopai

JUNE 27, 2022

Sit back and imagine how you would feel when…. This data catalog is helping boost our bottom line.”. Your data team spends more time doing high-level analysis than it does searching for relevant datasets. Data catalog SUCCESS! Pick a data catalog that matches your enterprise’s needs.

Management 72

Management Metadata Visualization Data Governance 72

AWS Big Data

JUNE 6, 2023

AWS Glue Data Quality allows you to measure and monitor the quality of data in your data repositories. It’s important for business users to be able to see quality scores and metrics to make confident business decisions and debug data quality issues. An AWS Glue crawler crawls the results.

Data Quality 68

Data Quality Metrics Visualization Dashboards 68

AWS Big Data

OCTOBER 12, 2023

At launch, OpenSearch Serverless supported increasing capacity automatically in response to growing data sizes. At launch, OpenSearch Serverless supported increasing capacity automatically in response to growing data sizes. In the following figure, an index has four shards to handle the product catalog.

Data Processing 85

Data Processing Testing Management Analytics 85

CIO Business Intelligence

NOVEMBER 21, 2023

After all, 41% of employees acquire, modify, or create technology outside of IT’s visibility , and 52% of respondents to EY’s Global Third-Party Risk Management Survey had an outage — and 38% reported a data breach — caused by third parties over the past two years. That’s not to downplay the inherent risks of shadow IT.

IT 137

IT Risk Cost-Benefit Risk Management 137

AWS Big Data

JUNE 6, 2023

Alerts and notifications play a crucial role in maintaining data quality because they facilitate prompt and efficient responses to any data quality issues that may arise within a dataset. It simplifies your experience of monitoring and evaluating the quality of your data.

Data Quality 71

Data Quality Metrics Data-driven Visualization 71

Octopai

FEBRUARY 20, 2022

That’s the data dream, right? Deciding to migrate your data from legacy, on-prem databases to a cloud-based data warehouse like Snowflake is often a step in the right direction. Let’s take a look at some concrete steps to set you up for a Snowflake data migration that will deliver better insights at a lower cost to you.

Data Warehouse 92

Data Warehouse Optimization Measurement Visualization 92

Alation

JULY 19, 2021

Metadata is information about data. A clothing catalog or dictionary are both examples of metadata repositories. Indeed, a popular online catalog, like Amazon, offers rich metadata around products to guide shoppers: ratings, reviews, and product details are all examples of metadata. What Is Metadata? Why Is Metadata Important?

Metadata 105

Metadata Management Data Governance Machine Learning 105

AWS Big Data

NOVEMBER 17, 2023

Athena provides a simplified, flexible way to analyze petabytes of data where it lives. You can analyze data or build applications from an Amazon Simple Storage Service (Amazon S3) data lake and 30 data sources, including on-premises data sources or other cloud systems using SQL or Python.

Optimization 109

Optimization Statistics Metadata Data Lake 109

Alation

JUNE 14, 2021

The Role of Catalog in Data Security. We discuss how they are running the business of IT and cover subjects like digital transformation, business/IT alignment, IT leadership, and leading innovation. Recently, I dug in with CIOs on the topic of data security. Recently, I dug in with CIOs on the topic of data security.

Data Governance 97

Data Governance Recreation/Entertainment Data Lake Digital Transformation 97

Alation

JANUARY 9, 2023

No matter where you reside, it seems as if significant data breaches happen almost weekly. A recent flurry of data breaches resulting in the disclosure of private data covering tens of millions of Australians has renewed the visibility of regulations that compel organisations to better protect consumer data.

Risk Management 52

Risk Management Risk Management Metadata 52

Alation

FEBRUARY 13, 2020

Data catalogs have quickly become a core component of modern data management. Organizations with successful data catalog implementations see remarkable changes in the speed and quality of data analysis, and in the engagement and enthusiasm of people who need to perform data analysis.

Metadata 64

Metadata Data Lake Recreation/Entertainment Big Data 64

Alation

MAY 12, 2023

So when leading software review site TrustRadius announced that we had won their “Top Rated” awards in Data Catalog , Data Collaboration, Data Governance , and Metadata Management we were thrilled, but not surprised, since usability has been core to Alation’s product DNA since day 1. What does “Top Rated” mean?

Metadata 52

Metadata Data Governance Data-driven Sales 52

AWS Big Data

APRIL 25, 2024

In the era of data, organizations are increasingly using data lakes to store and analyze vast amounts of structured and unstructured data. Data lakes provide a centralized repository for data from various sources, enabling organizations to unlock valuable insights and drive data-driven decision-making.

Optimization 66

Optimization Data Lake Cost-Benefit Reporting 66

IBM Big Data Hub

APRIL 4, 2024

Lots of innovation is happening, with new technologies emerging in areas such as data and AI, payments, cybersecurity and risk management, to name a few. Lots of innovation is happening, with new technologies emerging in areas such as data and AI, payments, cybersecurity and risk management, to name a few.

Cost-Benefit 61

Cost-Benefit Risk Management Risk Digital Transformation 61

O'Reilly on Data

DECEMBER 12, 2023

This ruling in itself raises many questions: how much creativity is needed, and is that the same kind of creativity that an artist exercises with a paintbrush? How do we make sense of this? Training an LLM means teaching it how to understand and reproduce human language. This distinction is attractive for several reasons.

Modeling 253

Modeling Software Sales Statistics 253

erwin

DECEMBER 3, 2020

As the amount of data grows exponentially, organizations turn to data intelligence to reach deeper conclusions about driving revenue, achieving regulatory compliance and accomplishing other strategic objectives. It’s no secret that data has grown in volume, variety and velocity, with 2.5 New products and services.

Metadata 141

Metadata Data Governance Data-driven Digital Transformation 141

IBM Big Data Hub

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

IBM Big Data Hub

DECEMBER 8, 2023

However, how do these organizations know that focusing on software with the highest scoring CVEs is the right approach? CISA strongly advises that organizations should regularly review and monitor the Known Exploited Vulnerabilities catalog and prioritize remediation.

Risk 76

Risk Testing Reporting Software 76

Alation

MAY 17, 2022

Folks can talk all day about automated insights, but answering ad hoc business questions still relies on human beings who understand the business context and how their bosses communicate. An enterprise data catalog is one such key asset. The Data Analyst Workflow. 7 Steps that Benefit from a Data Catalog.

Metadata 52

Metadata Data Quality Machine Learning Reporting 52

AWS Big Data

OCTOBER 3, 2023

A data lake is a centralized repository that you can use to store all your structured and unstructured data at any scale. You can store your data as-is, without having to first structure the data and then run different types of analytics for better business insights. Analytics use cases on data lakes are always evolving.

Data Lake 99

Data Lake Metadata Snapshot Recreation/Entertainment 99

AWS Big Data

NOVEMBER 6, 2023

In this post, we provide an overview of deferrable operators and triggers , including a walkthrough of an example showcasing how to use them. We also delve into some of the new features and capabilities of Apache Airflow, and how you can set up or upgrade your Amazon MWAA environment to version 2.7.2.

Metrics 100

Metrics Metadata Snapshot Management 100

Laminar Security

DECEMBER 1, 2023

Cloud data security is one of the most critical, yet most challenging aspects of doing business in the age of cloud. As more organizations migrate their data to the cloud, they face an increasing range of risks and threats, including data breaches, data leakage, data loss, data misuse, data compliance violations, shadow data and more.

Modeling 52

Modeling Cost-Benefit Risk Data-driven 52

Octopai

MARCH 23, 2022

Dirty Meat… and Dirty Data. But even though “dirty meat” is a small concern, “dirty data” is the scourge of any industry that relies heavily on information systems. But even though “dirty meat” is a small concern, “dirty data” is the scourge of any industry that relies heavily on information systems. Cleaning Up Dirty Data.

Data Quality 91

Data Quality Reporting Modeling Interactive 91

CIO Business Intelligence

APRIL 4, 2024

This involves rigorous evaluation of potential benefits, risks, and costs associated with each AI initiative to ensure investments are prudent and aligned with our risk-return profile.” We need to continue to be mindful of business outcomes and apply use cases that make sense.” We want to maintain discipline and go deep.”

Enterprise 134

Enterprise Cost-Benefit Forecasting Strategy 134

Alation

MAY 12, 2023

So when leading software review site TrustRadius announced that we had won their “Top Rated” awards in Data Catalog , Data Collaboration, Data Governance , and Metadata Management we were thrilled, but not surprised, since usability has been core to Alation’s product DNA since day 1. What does “Top Rated” mean?

Metadata 40

Metadata Data Governance Data-driven Sales 40

DataRobot Blog

MAY 10, 2022

The regulatory guidance presented in these documents laid the foundation for evaluating and managing model risk for financial institutions across the United States. The regulatory guidance presented in these documents laid the foundation for evaluating and managing model risk for financial institutions across the United States.

Risk 64

Risk Modeling Machine Learning Data Quality 64

AWS Big Data

AUGUST 11, 2023

Customers are implementing data and analytics workloads in the AWS Cloud to optimize cost. When implementing data processing workloads in AWS, you have the option to use technologies like Amazon EMR or serverless technologies like AWS Glue. This post is written in collaboration with Elijah Ball from Ontraport.

Data Processing 94

Data Processing Cost-Benefit Optimization Interactive 94

Alation

FEBRUARY 13, 2020

Whether we’re speaking to data analysts or CDOs, data people almost instantly understand the value of the Alation Data Catalog. Faces light up when we describe how Alation helps enterprises find, understand, trust, use and reuse data. There is plenty of market validation for the value of data catalogs.

ROI 52

ROI Cost-Benefit Unstructured Data Data Lake 52

erwin

JULY 22, 2020

Fostering organizational support for a data-driven culture might require a change in the organization’s culture. Recently, I co-hosted a webinar with our client E.ON , a global energy company that reinvented how it conducts business from branding to customer engagement – with data as the conduit. As an example, E.ON

Data-driven 136

Data-driven Data Governance Digital Transformation Enterprise 136

IBM Big Data Hub

AUGUST 24, 2022

The only question is, how do you ensure effective ways of breaking down data silos and bringing data together for self-service access? It starts by modernizing your data integration capabilities – ensuring disparate data sources and cloud environments can come together to deliver data in real time and fuel AI initiatives.

Data Integration 86

Data Integration Metadata Data-driven Data Architecture 86

DataKitchen

JUNE 7, 2021

This is a common question that we hear from our conversations with data scientists, engineers and analysts. This is a common question that we hear from our conversations with data scientists, engineers and analysts. How can one get started given these limitations? What can you do? DataOps is not an all-or-nothing proposition.

Testing 130

Testing IT Measurement Data-driven 130

Alation

OCTOBER 26, 2021

Today’s best-performing organizations embrace data for strategic decision-making. Because of the criticality of the data they deal with, we think that finance teams should lead the enterprise adoption of data and analytics solutions. This is because accurate data is “table stakes” for finance teams.

Finance 52

Finance Data Transformation Enterprise Metrics 52

Cloudera

MAY 1, 2023

Businesses everywhere have engaged in modernization projects with the goal of making their data and application infrastructure more nimble and dynamic. release of Cloudera’s SQL Stream Builder (available on CDP Public Cloud 7.2.16 What is a Project in SSB? All of these resources together make up the project.

Testing 79

Testing Management Data Processing IT 79