Jen Stirrup

FEBRUARY 23, 2024

To achieve AI ambitions, organizations need data and a cyber-resilient data platform to support them, and this will mean a growing need for data observability. As organizations become increasingly data-driven toward achieving AI ambitions, they recognize the need to ensure data accuracy, reliability, and quality.

Data-driven 73

Data-driven Data Governance Data Quality Cost-Benefit 73

Cloudera

MARCH 5, 2024

AI, and any analytics for that matter, are only as good as the data upon which they are based. Struggling to access and collect, oftentimes disparate and siloed, data across environments that are required to power AI, many organizations are unable to achieve the business insight and value they had hoped for.

Snapshot 87

Snapshot Data Lake Enterprise Data Governance 87

IBM Big Data Hub

OCTOBER 18, 2023

On December 5–6, 2023 at the Computer History Museum in Mountain View, CA, hundreds of developers and software engineers will come together at PrestoCon 2023 to support and learn more about Presto, the open-source SQL query engine for data analytics and the Open Data Lakehouse.

Statistics 100

Statistics Software Data Analytics Analytics 100

DataKitchen

OCTOBER 5, 2021

A DataOps Engineer owns the assembly line that’s used to build a data and analytic product. We find it helpful to think of data operations as a factory. Most organizations run the data factory using manual labor. Too many data organizations run data operations like a hundred-year-old car factory.

Testing 157

Testing Dashboards Measurement Experimentation 157

IBM Big Data Hub

SEPTEMBER 11, 2023

We are in the midst of an AI revolution where organizations are seeking to leverage data for business transformation and harness generative AI and foundation models to boost productivity, innovate, enhance customer experiences, and gain a competitive edge. Watsonx.data on AWS: Imagine having the power of data at your fingertips.

Data-driven 119

Data-driven Insurance Digital Transformation Data Warehouse 119

DataKitchen

NOVEMBER 4, 2021

Data organizations often have a mix of centralized and decentralized activity. DataOps concerns itself with the complex flow of data across teams, data centers and organizational boundaries. It expands beyond tools and data architecture and views the data organization from the perspective of its processes and workflows.

Data Processing 246

Data Processing Data Lake Cost-Benefit Testing 246

DataKitchen

JANUARY 5, 2021

Remote working has revealed the inconsistency and fragility of workflow processes in many data organizations. The data teams share a common objective; to create analytics for the (internal or external) customer. Data Science Workflow – Kubeflow, Python, R. Data Engineering Workflow – Airflow, ETL.

Testing 147

Testing Data Governance Metadata Visualization 147

Alation

JULY 15, 2021

Many data catalog initiatives fail. According to the latest report from Eckerson Group, Deep Dive on Data Catalogs , shoppers must match the goals of their organizations to the capabilities of their chosen catalog. A data catalog’s approach is key. Finding a trustworthy asset in a sea of data can take analysts months.

Reporting 98

Reporting Data Governance Recreation/Entertainment Metadata 98

Ontotext

FEBRUARY 12, 2024

Part one of this three-part series discussed the concept of data mesh and explored what it is and why an organization should care. Here, part two provides best practices for data mesh, including practical guidance, challenges, and limitations. Enterprises should identify and adopt specific data mesh elements to achieve velocity.

Data Quality 69

Data Quality Data-driven Data Lake Data Governance 69

IBM Big Data Hub

OCTOBER 16, 2023

This is where AI governance comes into play: addressing these potential and inevitable problems of adoption. AI governance refers to the practice of directing, managing and monitoring an organization’s AI activities. An AI governance framework ensures the ethical, responsible and transparent use of AI and machine learning (ML).

Risk 82

Risk Modeling Management Metadata 82

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

Cloudera

JULY 13, 2021

After the launch of CDP Data Engineering (CDE) on AWS a few months ago, we are thrilled to announce that CDE, the only cloud-native service purpose built for enterprise data engineers, is now available on Microsoft Azure. . CDP data lifecycle integration and SDX security and governance. Easy job deployment.

Enterprise 126

Enterprise Visualization Testing Management 126

IBM Big Data Hub

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures.

Optimization 58

Optimization Strategy Data Warehouse Cost-Benefit 58

AWS Big Data

JANUARY 17, 2024

This allows you to simplify security and governance over transactional data lakes by providing access controls at table-, column-, and row-level permissions with your Apache Spark jobs. Many large enterprise companies seek to use their transactional data lake to gain insights and improve decision-making.

Data Lake 89

Data Lake Snapshot Big Data Data-driven 89

Cloudera

APRIL 7, 2022

As a public sector leader, you don’t need the value of data explained to you. Simply collecting data isn’t enough anymore: government agencies must harness the value of that data in motion with an effective data strategy and platform. You already understand its importance to your vital missions. .

Data-driven 90

Data-driven Machine Learning Data Governance Data Strategy 90

IBM Big Data Hub

JANUARY 3, 2024

The COVID-19 pandemic revealed disturbing data about health inequity. There is a high likelihood that historically underserved communities may use a generative transformer, especially one that is embedded unknowingly into a search engine, to ask for medical advice. And institutional innovation can play a role to help.

Metadata 85

Metadata Modeling Testing Manufacturing 85

erwin

FEBRUARY 28, 2024

At Sparkle, we’re a holistic data partner helping organizations increase their data maturity in a strategic yet pragmatic way. One of the key ingredients to ensure data is really embedded in an organization, and one of the key enablers to increase the strategic impact of data, is the setup of a successful data governance program.

Metadata 52

Metadata Data Governance Data Quality Technology 52

Smart Data Collective

NOVEMBER 20, 2022

We have talked extensively about the benefits of data centers in the past. Many organizations are increasing their Big Data footprint and looking to data centers to help them grow. Global companies are projected to spend over $274 billion on big data this year and data cetners have played a role in this trend.

Big Data 106

Big Data Advertising Marketing Technology 106

IBM Big Data Hub

JANUARY 25, 2024

Yet many AI creators are currently facing backlash for the biases, inaccuracies and problematic data practices being exposed in their models. Simply put, when the diversity in a group is large, the error of the crowd is small — supporting the concept of “the wisdom of the crowd.” How are you assessing fairness?

Predictive Modeling 95

Predictive Modeling Modeling Risk Statistics 95

IBM Big Data Hub

JUNE 8, 2023

Why is preserving current coral reefs and building engineered reefs important? However, many of these organizations lack a clear pathway to realizing their goals and 41% of surveyed executives cite inadequate data as their biggest obstacle to ESG progress.

Technology 89

Technology Measurement Cost-Benefit Data-driven 89

erwin

JULY 22, 2020

Fostering organizational support for a data-driven culture might require a change in the organization’s culture. Recently, I co-hosted a webinar with our client E.ON , a global energy company that reinvented how it conducts business from branding to customer engagement – with data as the conduit. As an example, E.ON

Data-driven 136

Data-driven Data Governance Digital Transformation Enterprise 136

Cloudera

OCTOBER 13, 2020

On September 24, 2019, Cloudera launched CDP Public Cloud (CDP-PC) as the first step in delivering the industry’s first Enterprise Data Cloud. CDP Machine Learning: a kubernetes-based service that allows data scientists to deploy collaborative workspaces with secure, self-service access to enterprise data. That Was Then.

Data Warehouse 92

Data Warehouse Machine Learning Visualization Data Lake 92

Cloudera

FEBRUARY 12, 2024

Get it wrong and your deployment may become wholly unusable with users unable to access and use the Cloudera data services. In this blog, we’ll take you through our tried and tested best practices for setting up your DNS for use with Cloudera on Azure. Not all managed services support services endpoint.

Data Warehouse 52

Data Warehouse Machine Learning Data Lake Management 52

Cloudera

DECEMBER 11, 2020

In a previous blog post on CDW performance, we compared Azure HDInsight to CDW. In this blog post, we compare Cloudera Data Warehouse (CDW) on Cloudera Data Platform (CDP) using Apache Hive-LLAP to EMR 6.0 (also powered by Apache Hive-LLAP) on Amazon using the TPC-DS 2.9 with support for ACID transactions.

Data Warehouse 106

Data Warehouse Metadata Machine Learning Measurement 106

Cloudera

NOVEMBER 1, 2022

It’s no secret that IT modernization is a top priority for the US federal government. These systems also pose security risks, including the inability to use current security best practices, such as data encryption and multi-factor authentication, making these systems particularly vulnerable to malicious cyber activity.

Cost-Benefit 85

Cost-Benefit Data Architecture Risk IoT 85

IBM Big Data Hub

MAY 31, 2023

This use case involves devices and equipment embedded with sensors, software and connectivity that exchange data with other products, operators or environments in real-time. In this blog post, we will look at the frequently overlooked phenomenon of connected products and how enterprises are using them to their advantage.

Manufacturing 105

Manufacturing Internet of Things IoT Data-driven 105

erwin

JANUARY 9, 2020

Enterprises are trying to manage data chaos. They also face increasing regulatory pressure because of global data regulations , such as the European Union’s General Data Protection Regulation (GDPR) and the new California Consumer Privacy Act (CCPA), that went into effect last week on Jan.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

Cloudera

MARCH 17, 2023

As the use of ChatGPT becomes more prevalent, I frequently encounter customers and data users citing ChatGPT’s responses in their discussions. I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics.

Unstructured Data 60

Unstructured Data Data Lake Data Warehouse Machine Learning 60

Cloudera

FEBRUARY 16, 2022

Model interpretability is one of five main components of model governance. In this article, we explore model governance, a function of ML Operations (MLOps). Each project consists of a declarative series of steps or operations that define the data science workflow. blueberry spacing) is a measure of the model’s interpretability.

Machine Learning 82

Machine Learning Modeling Metadata Recreation/Entertainment 82

erwin

JANUARY 30, 2020

I’m excited to share the results of our new study with Dataversity that examines how data governance attitudes and practices continue to evolve. Defining Data Governance: What Is Data Governance? . 1 reason to implement data governance. Most have only data governance operations.

Data Governance 145

Data Governance Metadata Cost-Benefit Digital Transformation 145

CIO Business Intelligence

FEBRUARY 14, 2023

By George Trujillo, Principal Data Strategist, DataStax Increased operational efficiencies at airports. To succeed with real-time AI, data ecosystems need to excel at handling fast-moving streams of events, operational data, and machine learning models to leverage insights and automate decision-making.

Data Strategy 116

Data Strategy Strategy Machine Learning Data-driven 116

IBM Big Data Hub

AUGUST 24, 2022

The only question is, how do you ensure effective ways of breaking down data silos and bringing data together for self-service access? It starts by modernizing your data integration capabilities – ensuring disparate data sources and cloud environments can come together to deliver data in real time and fuel AI initiatives.

Data Integration 91

Data Integration Metadata Data-driven Data Architecture 91

AWS Big Data

MARCH 23, 2023

We recently announced support for AWS Lake Formation fine-grained access control policies in Amazon Athena queries for data stored in any supported file format using table formats such as Apache Iceberg, Apache Hudi and Apache Hive. Lake Formation provides an authorization and governance layer on data stored in Amazon S3.

Interactive 66

Interactive Snapshot Data Lake Software 66

IBM Big Data Hub

DECEMBER 19, 2023

As practices like DevOps , cloud native , serverless and site reliability engineering (SRE) mature, the focus is shifting toward significant levels of automation, speed, agility and business alignment with IT (which helps enterprise IT transform into engineering organizations).

Data-driven 77

Data-driven Software Enterprise Testing 77

AWS Big Data

JUNE 6, 2023

We are excited to announce the General Availability of AWS Glue Data Quality. Our journey started by working backward from our customers who create, manage, and operate data lakes and data warehouses for analytics and machine learning. To make confident business decisions, the underlying data needs to be accurate and recent.

Data Quality 92

Data Quality Statistics Data Lake Visualization 92

IBM Big Data Hub

SEPTEMBER 28, 2023

An AI and data platform, such as watsonx, can help empower businesses to leverage foundation models and accelerate the pace of generative AI adoption across their organization. Business-targeted, IBM-developed foundation models built from sound data Business leaders charged with adopting generative AI need model flexibility and choice.

Testing 97

Testing Finance Enterprise Modeling 97

IBM Big Data Hub

AUGUST 22, 2023

It uses real-world data (both real time and historical) combined with engineering, simulation or machine learning (ML) models to enhance operations and support human decision-making. By engaging with IBM Consulting, you can become an AI value creator, which allows you to train, deploy and govern data and AI models.

Unstructured Data 86

Unstructured Data Consulting Visualization IoT 86