O'Reilly on Data

JANUARY 29, 2019

In 2017, we published “ How Companies Are Putting AI to Work Through Deep Learning ,” a report based on a survey we ran aiming to help leaders better understand how organizations are applying AI through deep learning. We found companies were planning to use deep learning over the next 12-18 months.

Deep Learning 211

Deep Learning Machine Learning Data Science Metadata 211

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 86

Strategy Data Architecture Cost-Benefit Reporting 86

CIO Business Intelligence

OCTOBER 13, 2023

Application data architect: The application data architect designs and implements data models for specific software applications. Information/data governance architect: These individuals establish and enforce data governance policies and procedures.

Data Architecture 124

Data Architecture Data Warehouse Statistics Visualization 124

IBM Big Data Hub

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

AWS Big Data

MARCH 7, 2023

It covers how to use a conceptual, logical architecture for some of the most popular gaming industry use cases like event analysis, in-game purchase recommendations, measuring player satisfaction, telemetry data analysis, and more. A data hub contains data at multiple levels of granularity and is often not integrated.

Analytics 71

Analytics Data Warehouse Data Lake Metadata 71

Alation

JUNE 16, 2021

Alation … [offers a] dedicated data catalog… while others include this functionality as a part of a broader (e.g., business intelligence) solution. Wisdom of Crowds® research is based on data collected on usage and deployment trends, products, and vendors. Data governance is a growing focus.

Reporting 52

Reporting Business Intelligence Data Governance Metadata 52

CIO Business Intelligence

FEBRUARY 14, 2024

As the cost of data storage has fallen, many organizations are keeping unnecessary data, or cleaning up data that’s out of date or no longer useful after a migration or reorganization. Do you want to have an even more powerful search capability with AI in your data, and to be unsure about how you’ve organized that data?”

IT 140

IT Metadata Data-driven Management 140

Domino Data Lab

APRIL 3, 2019

Paco Nathan ‘s latest column dives into data governance. This month’s article features updates from one of the early data conferences of the year, Strata Data Conference – which was held just last week in San Francisco. In particular, here’s my Strata SF talk “Overview of Data Governance” presented in article form.

Data Governance 84

Data Governance Machine Learning Metadata Big Data 84

Alation

FEBRUARY 13, 2020

This achievement is a testament not only to our legacy of helping to create the data catalog category but also to our continued innovation in improving the effectiveness of self-service analytics. A broader definition of Business Intelligence. Howard Dresner coined the term “Business Intelligence” in 1989.

Business Intelligence 52

Business Intelligence Machine Learning Marketing Metadata 52

CIO Business Intelligence

MARCH 29, 2022

It isn’t practical to save all your data, but it is important to realize data may be valuable for other projects. You lose that add-on value when you throw data away. . This type of data waste results in missing out on the second project advantage. You have data but don’t use it.

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Data Quality 52

Domino Data Lab

JULY 22, 2019

data science’s emergence as an interdisciplinary field – from industry, not academia. why data governance, in the context of machine learning is no longer a “dry topic” and how the WSJ’s “global reckoning on data governance” is potentially connected to “premiums on leveraging data science teams for novel business cases”.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109

Jet Global

JULY 2, 2019

And using Azure’s built-in U-SQL library allows businesses allows you to write code once and have it automatically parallelized for the scale you need, whether in.NET languages, R, or Python. At the very worst, data lakes can provide a wealth of data that is impossible to analyze in a meaningful way due to incorrect metadata or cataloging.

Data Lake 73

Data Lake Data Warehouse Big Data Machine Learning 73

Alation

MAY 24, 2022

generally available on May 24, Alation introduces the Open Data Quality Initiative for the modern data stack, giving customers the freedom to choose the data quality vendor that’s best for them with the added confidence that those tools will integrate seamlessly with Alation’s Data Catalog and Data Governance application.

Data Quality 98

Data Quality Data Governance Metadata Metrics 98

Alation

JUNE 28, 2022

This is where metadata, or the data about data, comes into play. Having a data catalog is the cornerstone of your data governance strategy, but what supports your data catalog? Your metadata management framework provides the underlying structure that makes your data accessible and manageable.

Metadata 52

Metadata Management Data Governance Machine Learning 52

O'Reilly on Data

FEBRUARY 11, 2020

Just 20% of organizations publish data provenance and data lineage. Adopting AI can help data quality. Almost half (48%) of respondents say they use data analysis, machine learning, or AI tools to address data quality issues. Can AI be a catalyst for improved data quality?

Data Quality 311

Data Quality Metadata Data Governance Publishing 311

AWS Big Data

MARCH 10, 2023

However, as data processing at scale solutions grow, organizations need to build more and more features on top of their data lakes. Additionally, the task of maintaining and managing files in the data lake can be tedious and sometimes complex. The Iceberg table is synced with the AWS Glue Data Catalog.

Data Lake 102

Data Lake Sales Data Warehouse Snapshot 102

AWS Big Data

MAY 7, 2024

Data governance is a key enabler for teams adopting a data-driven culture and operational model to drive innovation with data. Amazon DataZone allows you to simply and securely govern end-to-end data assets stored in your Amazon Redshift data warehouses or data lakes cataloged with the AWS Glue data catalog.

Metadata 75

Metadata Data Lake Data Processing Data-driven 75

CIO Business Intelligence

DECEMBER 21, 2022

Every day, organizations of every description are deluged with data from a variety of sources, and attempting to make sense of it all can be overwhelming. So a strong business intelligence (BI) strategy can help organize the flow and ensure business users have access to actionable business insights. “By

IT 126

IT Business Intelligence Sales Key Performance Indicator 126

AWS Big Data

SEPTEMBER 25, 2023

With Amazon Redshift , you can run a complex mix of workloads on your data warehouse, such as frequent data loads running alongside business-critical dashboard queries and complex transformation jobs. We also see more and more data science and machine learning (ML) workloads. 5 Used by the superuser queue.

Management 95

Management Data Warehouse Metrics Dashboards 95

Alation

APRIL 14, 2022

Semantics, context, and how data is tracked and used mean even more as you stretch to reach post-migration goals. This is why, when data moves, it’s imperative for organizations to prioritize data discovery. Data discovery is also critical for data governance , which, when ineffective, can actually hinder organizational growth.

Metadata 59

Metadata Data Governance Modeling Data-driven 59

CIO Business Intelligence

JUNE 12, 2024

Some of the models are traditional machine learning (ML), and some, LaRovere says, are gen AI, including the new multi-modal advances. The generative AI is filling in data gaps,” she says. It’s not a silver bullet,” says Daniel Avancini, chief data officer at Indicium, an AI and data consultancy.

Modeling 132

Modeling Testing Cost-Benefit IT 132

Alation

OCTOBER 21, 2021

Data lakes also support the growing thirst for analysis by data scientists and data analysts, as well as the critical role of data governance. But setting up a data lake takes a thoughtful approach to ensure it’s positioned to prevent it from becoming a data swamp. Lack of metadata.

Data Lake 52

Data Lake Metadata Data Warehouse Data Governance 52

Domino Data Lab

JULY 2, 2019

In other words, using metadata about data science work to generate code. In this case, code gets generated for data preparation, where so much of the “time and labor” in data science work is concentrated. Doesn’t this seem like a worthy goal for machine learning—to make the machines learn to work more effectively?

Metadata 105

Metadata Machine Learning Data Science Data-driven 105

AWS Big Data

APRIL 28, 2023

The first post of this series describes the overall architecture and how Novo Nordisk built a decentralized data mesh architecture, including Amazon Athena as the data query engine. The third post will show how end-users can consume data from their tool of choice, without compromising data governance.

Data Governance 65

Data Governance Management Data-driven Data Lake 65

IBM Big Data Hub

JULY 13, 2023

This is the practice of creating, updating and consistently enforcing the processes, rules and standards that prevent errors, data loss, data corruption, mishandling of sensitive or regulated data, and data breaches. Data science tasks such as machine learning also greatly benefit from good data integrity.

Data Quality 63

Data Quality Data Integration Metadata Cost-Benefit 63

IBM Big Data Hub

OCTOBER 12, 2023

They’re built on machine learning algorithms that create outputs based on an organization’s data or other third-party big data sources. Sometimes, these outputs are biased because the data used to train the model was incomplete or inaccurate in some way. And that makes sense.

Cost-Benefit 76

Cost-Benefit Metadata Data Governance Modeling 76

Alation

MARCH 21, 2023

What are common data challenges for the travel industry? Some companies struggle to optimize their data’s value and leverage analytics effectively. When companies lack a data governance strategy , they may struggle to identify all consumer data or flag personal data as subject to compliance audits.

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

Alation

APRIL 7, 2021

A data catalog contains critical metadata (like schema information), which need to be secure and available to consumers at all times. Hence, the data catalog must be protected by enterprise-grade security. Alation possesses three unique capabilities: intelligence, active data governance, and broad, deep connectivity.

Data Governance 52

Data Governance Enterprise Metadata Cost-Benefit 52

IBM Big Data Hub

MARCH 14, 2024

This involves unifying and sharing a single copy of data and metadata across IBM® watsonx.data ™, IBM® Db2 ®, IBM® Db2® Warehouse and IBM® Netezza ®, using native integrations and supporting open formats, all without the need for migration or recataloging. .

Cost-Benefit 76

Cost-Benefit Metadata Optimization Management 76

CIO Business Intelligence

JULY 5, 2022

Data sovereignty is the ability to maintain legal control and authority of the data within the defined nation’s jurisdictional boundaries. This includes data flows and subsequent processing of that data located within the jurisdictional boundary in question. Data Governance, IT Leadership

Uncertainty 82

Uncertainty Metadata Machine Learning Data Governance 82

CIO Business Intelligence

JUNE 30, 2022

Data sovereignty is the ability to maintain legal control and authority of the data within the defined nation’s jurisdictional boundaries. This includes data flows and subsequent processing of that data located within the jurisdictional boundary in question. Data Governance, IT Leadership

Uncertainty 82

Uncertainty Metadata Machine Learning Data Governance 82

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale. Frequent table maintenance needs to be performed to prevent read performance from degrading over time.

Data Lake 113

Data Lake Metadata Optimization Statistics 113

O'Reilly on Data

MAY 21, 2019

Companies successfully adopt machine learning either by building on existing data products and services, or by modernizing existing models and algorithms. In this post, I share slides and notes from a keynote I gave at the Strata Data Conference in London earlier this year. Use ML to unlock new data types—e.g.,

Machine Learning 244

Machine Learning Technology Deep Learning Data Science 244

Alation

DECEMBER 15, 2021

Yet high-volume collection makes keeping that foundation sound a challenge, as the amount of data collected by businesses is greater than ever before. An effective data governance strategy is critical for unlocking the full benefits of this information. Data governance requires a system.

Data Governance 52

Data Governance Strategy Metadata Data Strategy 52

Alation

FEBRUARY 13, 2020

Key analyst firms like Forrester, Gartner, and 451 Research have cited “ soaring demands from data catalogs ”, pondered whether data catalogs are the “ most important breakthrough in analytics to have emerged in the last decade ,” and heralded the arrival of a brand new market: Machine Learning Data Catalogs.

Metadata 52

Metadata Machine Learning Data Governance Reporting 52

Alation

FEBRUARY 20, 2020

While this requires technology – AI, machine learning, log parsing, natural language processing,metadata management, this technology must be surfaced in a form accessible to business users – the data catalog. The Forrester Wave : Machine Learning Data Catalogs, Q2 2018.

Machine Learning 52

Machine Learning Marketing Reporting ROI 52

AWS Big Data

MAY 1, 2024

Solution overview OneData defines three personas: Publisher – This role includes the organizational and management team of systems that serve as data sources. Responsibilities include: Load raw data from the data source system at the appropriate frequency. Provide and keep up to date with technical metadata for loaded data.

Dashboards 111

Dashboards Publishing Data-driven Cost-Benefit 111