Cloudera

JANUARY 19, 2024

As described in our recent blog post , an SQL AI Assistant has been integrated into Hue with the capability to leverage the power of large language models (LLMs) for a number of SQL tasks. This blog post aims to help you understand what you can do to get started with generative AI assisted SQL using Hue image version ​​2023.0.16.0

Data Warehouse 71

Data Warehouse Data Processing Optimization Modeling 71

AWS Big Data

MAY 4, 2023

Amazon’s Open Data Sponsorship Program allows organizations to host free of charge on AWS. These datasets are distributed across the world and hosted for public use. Data scientists have access to the Jupyter notebook hosted on SageMaker. The OpenSearch Service domain stores metadata on the datasets connected at the Regions.

Data Processing 93

Data Processing Metadata Informatics Interactive 93

Cloudera

FEBRUARY 17, 2022

One of our previous blogs discussed the four paths to get from legacy platforms to CDP Private Cloud Base. In this blog and accompanying video, we deep dive into the mechanics of running an in-place upgrade from HDP3 to CDP Private Cloud Base. After Ambari has been upgraded, download the cluster blueprints with hosts.

Testing 96

Testing Data Processing Metadata Management 96

Cloudera

MARCH 9, 2021

In this blog, we’ll highlight the key CDP aspects that provide data governance and lineage and show how they can be extended to incorporate metadata for non-CDP systems from across the enterprise. Extending Atlas’ metadata model. The example 1_typedef-server.json describes the server typedef used in this blog. .

Data Governance 93

Data Governance Metadata Enterprise Data Processing 93

Cloudera

JUNE 25, 2021

This blog post outlines detailed step by step instructions to perform Hive Replication from an on-prem CDH cluster to a CDP Public Cloud Data Lake. The Sentry service serves authorization metadata from the database backed storage; it does not handle actual privilege validation. This blog post is not a substitute for that.

Data Lake 69

Data Lake Metadata Unstructured Data Management 69

Ontotext

OCTOBER 12, 2023

Both speakers talked about common metadata standards and adequate language resources as key enablers of efficient interoperable, multilingual projects. Just like the typewriter in the hall hosting the Poster’s park , LLMs are yet another tool poised to change the way we work with language.

Modeling 75

Modeling Recreation/Entertainment Data Processing Metadata 75

Cloudera

SEPTEMBER 29, 2022

The data product is not just the data itself, but a bunch of metadata that surrounds it — the simple stuff like schema is a given. It is also agnostic to where the different domains are hosted. There are tons of blogs/videos etc about data mesh. This team or domain expert will be responsible for the data produced by the team.

Data Architecture 73

Data Architecture Metadata Data Warehouse Sales 73

Ontotext

DECEMBER 1, 2023

Atanas Kiryakov presenting at KGF 2023 about Where Shall and Enterprise Start their Knowledge Graph Journey Only data integration through semantic metadata can drive business efficiency as “it’s the glue that turns knowledge graphs into hubs of metadata and content”.

Metadata 78

Metadata Sales Consulting Enterprise 78

erwin

APRIL 16, 2021

erwin recently hosted the third in its six-part webinar series on the practice of data governance and how to proactively deal with its complexities. This webinar will discuss how to answer critical questions through data catalogs and business glossaries, powered by effective metadata management. erwin Data Intelligence.

Data Governance 128

Data Governance Metadata Cost-Benefit Digital Transformation 128

Ontotext

SEPTEMBER 15, 2020

This means the creation of reusable data services, machine-readable semantic metadata and APIs that ensure the integration and orchestration of data across the organization and with third-party external data. This means having the ability to define and relate all types of metadata.

Metadata 69

Metadata Knowledge Discovery Data Quality Strategy 69

Cloudera

APRIL 23, 2021

To prevent the management of these keys (which can run in the millions) from becoming a performance bottleneck, the encryption key itself is stored in the file metadata. Each file will have an EDEK which is stored in the file’s metadata. Select hosts for Active and Passive KTS servers. Data in the file is encrypted with DEK.

Data Processing 69

Data Processing Metadata Testing Management 69

AWS Big Data

NOVEMBER 22, 2023

The workflow consists of the following high level steps: Cataloging the Amazon S3 Bucket: Utilize AWS Glue Crawler to crawl the designated Amazon S3 bucket, extracting metadata, and seamlessly storing it in the AWS Glue data catalog. We’ll query these tables using Amazon Athena and Amazon Redshift Spectrum. Keep the default option.

Statistics 101

Statistics Data Lake Optimization Data-driven 101

AWS Big Data

JUNE 7, 2023

This is a guest blog post co-written with Sumesh M R from Cargotec and Tero Karttunen from Knowit Finland. In this blog, we discuss the technical challenges faced by Cargotec in replicating their AWS Glue metadata across AWS accounts, and how they navigated these challenges successfully to enable cross-account data sharing.

Metadata 56

Metadata Data Lake Machine Learning Big Data 56

erwin

APRIL 2, 2021

Protecting what traditionally has been considered personally identifiable information (PII) — people’s names, addresses, government identification numbers and so forth — that a business collects, and hosts is just the beginning of GDPR mandates.

Data Governance 106

Data Governance Cost-Benefit Risk Metadata 106

datapine

SEPTEMBER 29, 2022

It involves: Reviewing data in detail Comparing and contrasting the data to its own metadata Running statistical models Data quality reports. Many companies use so-called “legacy systems” for their databases that are decades old, and when the inevitable transition time comes, there’s a whole host of problems to deal with.

Data Quality 241

Data Quality Metrics Data-driven Management 241

Alation

FEBRUARY 20, 2020

What the mapping is of technical metadata to business descriptions. Alation Connect synchronizes metadata, sample data, and query logs into the Alation Data Catalog. All connections allow for Alation Data Catalog to automatically inventory & catalog queries and these engines may be hosted and operated on-premise or in the cloud.

Metadata 52

Metadata Enterprise Data Processing Data Architecture 52

Alation

MAY 11, 2023

In this blog, I’ll detail how we’ve grown in EMEA specifically, sharing exciting updates and plans for the future. This multi-brand online retailer hosts thousands of products for sale on the internet and collects millions of bits and bytes of data across customer touchpoints each day. But first: mark your calendars!

B2B 52

B2B Finance Data Governance Marketing 52

AWS Big Data

MARCH 30, 2023

Amazon Elastic Kubernetes Service (Amazon EKS) is becoming a popular choice among AWS customers to host long-running analytics and AI or machine learning (ML) workloads. services.k8s.aws/v1alpha1 kind: Bucket metadata: name: sparkjob-demo-bucket spec: name: sparkjob-demo-bucket kubectl apply -f ack-yamls/s3.yaml We use the s3.yaml

Data-driven 70

Data-driven Metadata Testing Management 70

Alation

APRIL 14, 2023

In this blog, I’ll share a quick high-level overview of the event, with an eye to core themes. In his talk, Mitesh revealed that Alation delivers useful information about data via metadata, and explored why context is key to building reliable data pipelines. Let’s dive in! Keen to learn more about Fivetran’s evolution?

Data Warehouse 52

Data Warehouse Data-driven Digital Transformation Metadata 52

Alation

NOVEMBER 28, 2022

And they rarely, if ever, host the most current data available. In the future, spreadsheet users will be able to curate and publish rich metadata about their spreadsheets back into the data catalog. A centralized repository of metadata on the spreadsheets will eliminate this confusion. Subscribe to Alation's Blog.

Metadata 52

Metadata Enterprise Cost-Benefit Finance 52

CIO Business Intelligence

APRIL 27, 2022

Rajgopal adds that all customer data, metadata, and escalation data are kept on Indian soil at all times in an ironclad environment. For more perspectives on Sovereign Cloud solutions, read the latest partner blogs from AU Cloud , NxtGen , ThinkOn and Tieto. These are questions and thoughts for all CIOs to ponder.

Digital Transformation 105

Digital Transformation Metadata Risk Management 105

Ontotext

NOVEMBER 22, 2020

Content Enrichment and Metadata Management. The value of metadata for content providers is well-established. When that metadata is connected within a knowledge graph, a powerful mechanism for content enrichment is unlocked. Ontotext Platform can be employed for a number of applications within an enterprise.

Metadata 72

Metadata Cost-Benefit Unstructured Data Technology 72

Cloudera

MAY 12, 2021

2020 saw us hosting our first ever fully digital Data Impact Awards ceremony, and it certainly was one of the highlights of our year. The post Announcing the 2021 Data Impact Awards appeared first on Cloudera Blog. SECURITY AND GOVERNANCE LEADERSHIP. Show us what is possible! .

Digital Transformation 66

Digital Transformation Machine Learning Optimization Data Lake 66

Alation

MAY 11, 2023

In this blog, I’ll detail how we’ve grown in EMEA specifically, sharing exciting updates and plans for the future. This multi-brand online retailer hosts thousands of products for sale on the internet and collects millions of bits and bytes of data across customer touchpoints each day. But first: mark your calendars!

B2B 40

B2B Finance Data Governance Marketing 40

Rita Sallam

APRIL 2, 2023

We also gave the demo script and data set to all vendors in the Exhibit Hall to create demos for their booths and to submit for this blog. This blog highlights some notable findings and the videos from participating vendors. From there, participants were randomly selected and invited to present live at the Show Floor Showdown sessions.

Optimization 52

Optimization Machine Learning Insurance Risk 52

Laminar Security

NOVEMBER 16, 2023

To learn more about the differences between DSPM and CSPM, check out our blog post on DSPM vs CSPM , and why you need both for comprehensive cloud security. You can then use CSPM to check if your cloud resources that host or access this data are securely configured and comply with the relevant regulations or standards.

Risk 59

Risk Cost-Benefit Dashboards Management 59

Cloudera

SEPTEMBER 1, 2020

With HDFS, Solr servers are essentially stateless, so host failures have minimal consequences. Coordinates distribution of data and metadata, also known as shards. For the examples presented in this blog, we assume you have a CDP account already. Includes a drag-n-drop style, GUI-based Search Dashboard Designer.

Snapshot 67

Snapshot Unstructured Data Dashboards Interactive 67

Cloudera

NOVEMBER 12, 2020

Inability to maintain context – This is the worst of them all because every time a data set or workload is re-used, you must recreate its context including security, metadata, and governance. This feature ensures workloads remain in context with all common data, including metadata management, data governance, and security policies.

Data Warehouse 102

Data Warehouse Reporting Risk Cost-Benefit 102

Cloudera

JULY 19, 2023

It is a replicated, highly-available service that is responsible for managing the metadata for all objects stored in Ozone. In this blog post, we will highlight the work done recently to improve the performance of Ozone Manager to scale to exabytes of data. The hardware specifications are included at the end of this blog.

Management 69

Management Metadata Metrics Optimization 69

IBM Big Data Hub

FEBRUARY 26, 2024

Download the Gartner® Market Guide for Active Metadata Management 1. Efficient cloud migrations McKinsey predicts that $8 out of every $10 for IT hosting will go toward the cloud by 2024. The post 6 benefits of data lineage for financial services appeared first on IBM Blog.

Cost-Benefit 100

Cost-Benefit Metadata Data Governance Reporting 100

Alation

FEBRUARY 13, 2020

Graves: As I mentioned, one of the key things for us is that we sell web products for our customers to build their own web presence – domains, hosting, shopping carts, and SSL certs. Subscribe to Alation's Blog. What role does data play in your customer-first culture? Are they stopping somewhere in setup? Thank you Sharon.

Digital Transformation 52

Digital Transformation Data-driven Business Intelligence Big Data 52

IBM Big Data Hub

JANUARY 9, 2024

Data ingestion must be done properly from the start, as mishandling it can lead to a host of new issues. 4 key components to ensure reliable data ingestion Data quality and governance: Data quality means ensuring the security of data sources, maintaining holistic data and providing clear metadata.

Enterprise 79

Enterprise Data Integration Data Quality Contextual Data 79

IBM Big Data Hub

APRIL 11, 2024

We recommend that these hackathons be extended in scope to address the challenges of AI governance, through these steps: Step 1: Three months before the pilots are presented, have a candidate governance leader host a keynote on AI ethics to hackathon participants. We find that most are disincentivized because they have quotas to meet.

Risk 78

Risk Consulting Modeling Data Processing 78

AWS Big Data

MARCH 9, 2023

SCD2 metadata – rec_eff_dt and rec_exp_dt indicate the state of the record. Register source tables in the AWS Glue Data Catalog We use an AWS Glue crawler to infer metadata from delimited data files like the CSV files used in this post. When you’re creating the AWS Glue crawler, create a new database named rs-dimension-blog.

Slice and Dice 79

Slice and Dice Data Warehouse Metrics Metadata 79

IBM Big Data Hub

APRIL 1, 2024

GitOps for repo data Backstage allows developers and teams to express the metadata about their projects from yaml files. ” Rather than paying a cloud to host that proxy for you, you can move that proxy into Backstage and present it as a single product. This is like APIGEE or APIM, but “in-house.”

Software 78

Software Advertising Data Processing Metadata 78

Cloudera

OCTOBER 25, 2021

Cruise Control will automatically rebalance the partition replicas on the cluster making use of the newly added brokers in the event of an up scale, or down scaling will move replicas off the hosts that are targeted to be decommissioned. an Atlas hook was provided that once configured allows for Kafka metadata to be collected.

Metrics 87

Metrics Data Processing Metadata Management 87

Cloudera

NOVEMBER 17, 2022

The platform’s capabilities in security, metadata, and governance will provide robust support to HBL’s focus on compliance and keeping data clean and safe in an increasingly complex regulatory and threat environment. The post Habib Bank manages data at scale with Cloudera Data Platform appeared first on Cloudera Blog.

Management 82

Management Data Lake Consulting Unstructured Data 82