Analytics Vidhya

DECEMBER 28, 2022

This article was published as a part of the Data Science Blogathon. Choosing the best appropriate activation function can help one get better results with even reduced data quality; hence, […].

Deep Learning 254

Deep Learning Data Quality Data Science Publishing 254

Analytics Vidhya

SEPTEMBER 2, 2021

This article was published as a part of the Data Science Blogathon Overview Running data projects takes a lot of time. Poor data results in poor judgments. Running unit tests in data science and data engineering projects assures data quality. You know your code does what you want it to do.

Testing 321

Testing Data Quality Data-driven Data Science 321

Andrew White

AUGUST 26, 2020

I spoke to a client recently who had this question: “I need help to develop a survey to ask our employees around the company how they regard the various subjective metrics tied to data quality.” What was the point of the data quality work? I explained to the client: Stop this bottom up data-focused work.

Data Quality 52

Data Quality Data Governance Metrics Measurement 52

O'Reilly on Data

FEBRUARY 11, 2020

We suspected that data quality was a topic brimming with interest. The responses show a surfeit of concerns around data quality and some uncertainty about how best to address those concerns. Key survey results: The C-suite is engaged with data quality. Data quality might get worse before it gets better.

Data Quality 304

Data Quality Metadata Data Governance Publishing 304

Octopai

OCTOBER 26, 2022

DataOps is an approach to best practices for data management that increases the quantity of data analytics products a data team can develop and deploy in a given time while drastically improving the level of data quality. Did you just have a spectacular new idea for a data analytics product?

Data Quality 52

Data Quality Data Analytics Analytics Manufacturing 52

Dataiku

JULY 5, 2023

Anyway, the company is a digital native but, like most everyone else, strives to improve their data culture. Their central data team publishes “official” data products and dashboards for things like sales and website traffic.

Data Quality 59

Data Quality Dashboards Sales Publishing 59

Smart Data Collective

APRIL 5, 2022

Here at Smart Data Collective, we never cease to be amazed about the advances in data analytics. We have been publishing content on data analytics since 2008, but surprising new discoveries in big data are still made every year. One of the biggest trends shaping the future of data analytics is drone surveying.

Data Collection 109

Data Collection Data Quality Big Data Data-driven 109

O'Reilly on Data

JUNE 18, 2019

As model building become easier, the problem of high-quality data becomes more evident than ever. Even with advances in building robust models, the reality is that noisy data and incomplete data remain the biggest hurdles to effective end-to-end solutions. Data integration and cleaning.

Machine Learning 259

Machine Learning Data Quality Statistics Modeling 259

Ontotext

FEBRUARY 12, 2024

Domain teams should continually monitor for data errors with data validation checks and incorporate data lineage to track usage. Establish and enforce data governance by ensuring all data used is accurate, complete, and compliant with regulations.

Data Quality 69

Data Quality Data-driven Data Lake Data Governance 69

Cloudera

MARCH 3, 2022

The medical insurance company wasn’t hacked, but its customers’ data was compromised through a third-party vendor’s employee. In the 2020 O’Reilly Data Quality survey only 20% of respondents say their organizations publish information about data provenance or data lineage internally.

Data Governance 100

Data Governance Enterprise Data Quality Metadata 100

AWS Big Data

APRIL 4, 2024

Griffin is an open source data quality solution for big data, which supports both batch and streaming mode. In today’s data-driven landscape, where organizations deal with petabytes of data, the need for automated data validation frameworks has become increasingly critical.

Data Quality 61

Data Quality Data Lake Data Warehouse Data-driven 61

CIO Business Intelligence

SEPTEMBER 1, 2023

Sun has a PhD from MIT and continued to publish academic research papers during his time at Microsoft, in addition to teaching at Seattle and Washington universities. SAP has appointed a new global head of artificial intelligence, Walter Sun, after the previous post-holder quit to found her own AI startup.

IT 105

IT Reporting Forecasting Data Quality 105

Jim Harris

MARCH 9, 2022

OCDQ Radio is an audio podcast about data quality and its related disciplines, produced and hosted by Jim Harris.

Big Data 52

Big Data Data Science Data Quality Data Processing 52

Jim Harris

MARCH 5, 2022

OCDQ Radio is an audio podcast about data quality and its related disciplines, produced and hosted by Jim Harris.

Data Governance 52

Data Governance Data Quality Data Processing Publishing 52

CIO Business Intelligence

MAY 24, 2023

The first published data governance framework was the work of Gwen Thomas, who founded the Data Governance Institute (DGI) and put her opus online in 2003. They already had a technical plan in place, and I helped them find the right size and structure of an accompanying data governance program.

Data Governance 118

Data Governance Data Quality Data Collection Management 118

DataRobot Blog

MAY 10, 2022

It has been over a decade since the Federal Reserve Board (FRB) and the Office of the Comptroller of the Currency (OCC) published its seminal guidance focused on Model Risk Management ( SR 11-7 & OCC Bulletin 2011-12 , respectively). To reference SR 11-7: .

Risk 64

Risk Modeling Machine Learning Data Quality 64

AWS Big Data

JUNE 6, 2023

Data consumers lose trust in data if it isn’t accurate and recent, making data quality essential for undertaking optimal and correct decisions. Evaluation of the accuracy and freshness of data is a common task for engineers. Currently, various tools are available to evaluate data quality.

Data Quality 71

Data Quality Data Lake Data-driven Metrics 71

Andrew White

DECEMBER 4, 2019

Click here for an interactive PDF to connect to the most read data and analytics research directly. A raft of new notes published last week but there had to be one top spot! Its all about maximizing your return on data quality technology investments. This list excludes our branded research such as Magic Quadrants etc.

Analytics 59

Analytics Data Quality Interactive Publishing 59

TDAN

DECEMBER 20, 2022

It has been eight years plus since the first edition of my book, Non-Invasive Data Governance: The Path of Least Resistance and Greatest Success, was published by long-time TDAN.com contributor, Steve Hoberman, and his publishing company Technics Publications. That seems like a long time ago.

Data Governance 91

Data Governance Publishing Data Quality IT 91

erwin

MARCH 30, 2020

As a result, the data may be compromised, rendering faulty analyses and insights. To marry the epidemiological data to the population data it will require a tremendous amount of data intelligence about the: Source of the data; Currency of the data; Quality of the data; and.

Metadata 122

Metadata IT Data Governance Data Quality 122

Ontotext

NOVEMBER 16, 2023

Data mesh solves this by promoting data autonomy, allowing users to make decisions about domains without a centralized gatekeeper. It also improves development velocity with better data governance and access with improved data quality aligned with business needs.

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

DataRobot

AUGUST 18, 2021

Along with raw data entries in these statements, additional financial ratios such as year-on-year changes in return on assets or book-to-market value are useful machine learning features as well. The dataset used in the following example was published in the Journal of Accounting Research.

Machine Learning 52

Machine Learning Data Quality Modeling Sales 52

IBM Big Data Hub

SEPTEMBER 15, 2023

These disclosures will need to be filed as part of the company annual 10-K statements, potentially as soon as the 2024 fiscal year if the final ruling is published by October 2023 as currently expected. For example, the regulated disclosures could be anything from estimates around Scope 3 emissions, to investor-grade data.

Risk 80

Risk Reporting Data-driven Publishing 80

datapine

SEPTEMBER 27, 2022

Our next book is dedicated to anyone who wants to start a career as a data scientist and is looking to get all the knowledge and skills in a way that is accessible and well-structured. Originally published in 2018, the book has a second edition that was released in January of 2022. 4) “SQL Performance Explained” by Markus Winand.

Business Intelligence 292

Business Intelligence Data Warehouse Data Processing Data mining 292

erwin

JULY 12, 2019

It also helps enterprises put these strategic capabilities into action by: Understanding their business, technology and data architectures and their inter-relationships, aligning them with their goals and defining the people, processes and technologies required to achieve compliance.

Data Governance 110

Data Governance Management Metadata Risk Management 110

CIO Business Intelligence

JUNE 2, 2022

It’s sort of like teaching a child to identify different animals: this is a rabbit, this is a donkey and so on,” King said, in a published interview. “If Modern data analytics spans a range of technologies, from dedicated analytics platforms and databases to deep learning and artificial intelligence (AI).

Machine Learning 142

Machine Learning Deep Learning Data Quality Strategy 142

Jedox

NOVEMBER 19, 2020

In this blog we take a closer look at the recently published BARC study “Sound Decisions in Dynamic Times.” The improvement in data quality follows with 53%. This finding is in line with what US-based FP&A expert Brian Kalish recently stated in his guest blog on data analysis : Data is abundant.

Forecasting 89

Forecasting Reporting Data Quality Marketing 89

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

Alation

MARCH 14, 2023

Data gathering and use pervades almost every business function these days — and it’s widely acknowledged that businesses with a clear strategy around data are best placed to succeed in competitive, challenging markets such as defence.

Data Strategy 52

Data Strategy Strategy Metadata Data Quality 52

IBM Big Data Hub

JANUARY 8, 2024

 It includes a built-in schema registry to validate event data from applications as expected, improving data quality and reducing errors. It provides a catalog for publishing event interfaces for others to discover. Flexible and customizable Kafka configurations can be automated by using a simple user interface.

Data-driven 81

Data-driven Management Advertising Enterprise 81

Peter James Thomas

AUGUST 16, 2019

When I recently published the latest edition of The Data & Analytics Dictionary , I included an entry on Charts which briefly covered a number of the most frequently used ones. This will be published in the next couple of weeks. Click to view a larger version in a new window. Colour / appearance. Number of satellites [6].

Publishing 75

Publishing Metrics Data Quality Measurement 75

Ontotext

JANUARY 26, 2023

published as a special topic article in AI magazine, Volume 43, Issue 1 , Spring 2022. The paper introduces KnowWhereGraph (KWG) as a solution to the ever-growing challenge of integrating heterogeneous data and building services on top of already existing open data. web service/API interfaces and communication protocols).

Interactive 52

Interactive Metadata Data Integration Data-driven 52

Octopai

APRIL 19, 2021

He is the President of Knowledge Integrity, Inc and an expert in master data management, data quality, and business intelligence. His articles on TDWI deal with advice for analysts, customer data profiling, master data management technology, and machine learning. . It is published by Robert S.

Metadata 52

Metadata Management Business Intelligence Data Governance 52

DataKitchen

MARCH 16, 2023

What are the metrics that matter? Gartner attempted to list every metric under the sun in their recent report , “T oolkit: Delivery Metrics for DataOps, Self-Service Analytics, ModelOps, and MLOps, ” published February 7, 2023. For example, Gartner’s DataOps metrics can be categorized into Velocity, Efficiency, and Quality.

Metrics 130

Metrics Data Analytics Analytics Measurement 130

Alation

AUGUST 17, 2022

Data governance policy should be owned by the top of the organization so data governance is given appropriate attention — including defining what’s a potential risk and what is poor data quality.” It comes down to the question: What is the value of your data?

Data Governance 92

Data Governance Risk Data-driven Measurement 92

Octopai

JANUARY 19, 2020

BCBS 239 is a document published by that committee entitled, Principles for Effective Risk Data Aggregation and Risk Reporting. The document, first published in 2013, outlines best practices for global and domestic banks to identify, manage, and report risks, including credit, market, liquidity, and operational risks.

Metadata 61

Metadata Risk Management Business Intelligence Data Governance 61

Andrew White

DECEMBER 4, 2019

If I am moved to write research about a vendor, I’ll write it and publish it behind our pay wall, in the assumption the advice is valuable. If you read my blog regularly then you know I rarely write about IT vendors. Single source of truth has been possible for many years – Salesforce is not the only vendor that can support this.

Digital Transformation 64

Digital Transformation Data Integration Data Quality Data Warehouse 64