Octopai

APRIL 24, 2023

This new native integration enhances our data lineage solution by providing seamless integration with one of the most powerful cloud-based data warehouses, benefiting data teams and enabling support for a broader range of data lineage, discovery, and catalog.

Cost-Benefit 96

Cost-Benefit Data-driven Data Warehouse Data Governance 96

O'Reilly on Data

APRIL 25, 2019

The O’Reilly Data Show Podcast: Neelesh Salian on data lineage, data governance, and evolving data platforms. In this episode of the Data Show , I spoke with Neelesh Salian , software engineer at Stitch Fix , a company that combines machine learning and human expertise to personalize shopping.

Machine Learning 201

Machine Learning Data Governance Software Technology 201

Octopai

MAY 15, 2023

How can you save your organizational data management and hosting cost using automated data lineage. Do you think you did everything already to save organizational data management costs? What kind of costs organization has that data lineage can help with? Well, you probably haven’t done this yet!

Data Quality 52

Data Quality Data Governance Data Integration Risk 52

Octopai

APRIL 4, 2022

We have very impersonal data driving decisions of very personal impact. . Sometimes it takes some ancient wisdom coupled with modern intelligence – and modern data intelligence – to make our healthcare ideals a reality. . But all of this information is scattered throughout multiple layers of the healthcare data ecosystem.

Metadata 92

Metadata Reporting Visualization Insurance 92

erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. It’s paramount that organizations understand the benefits of automating end-to-end data lineage. The importance of end-to-end data lineage is widely understood and ignoring it is risky business.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

erwin

SEPTEMBER 10, 2020

Not Documenting End-to-End Data Lineage Is Risky Busines – Understanding your data’s origins is key to successful data governance. Not everyone understands what end-to-end data lineage is or why it is important. Data Lineage Tells an Important Origin Story. Who are the data owners?

Data Governance 131

Data Governance Key Performance Indicator Digital Transformation Metadata 131

Smart Data Collective

APRIL 20, 2022

Errors in data entry might have serious effects if they are not discovered quickly. Human mistake is the most common cause of data entry errors. Since typical data entry errors may be minimized with the right steps, there are numerous data lineage tool strategies that a corporation can follow.

Data Processing 135

Data Processing Data Collection Technology Optimization 135

Octopai

SEPTEMBER 27, 2023

In today’s fast-paced digital era, businesses are inundated with vast amounts of data. Octopai’s revolutionary support for Databricks, emphasizes real-time data lineage and unparalleled simplicity. By emphasizing real-time data lineage and simplicity, we’re redefining how businesses interact with Databricks.

Metadata 52

Metadata Visualization Data Integration Data-driven 52

Octopai

JANUARY 30, 2023

Amazon , Azure and Google all happily offer cloud data storage cost calculators that will make your head spin with their specificity. How many TiB of data do you need for Streaming Reads on Google BigQuery? Step 1: Investigation One of the simplest ways of reducing data storage costs is to store less data. Obvious, yes.

Optimization 83

Optimization Data Warehouse Reporting IT 83

Octopai

APRIL 23, 2022

If, however, your organization lacks the funds for a time machine (along with the funds for unlimited data intelligence solutions), here are our top four picks for the situations in which you should prioritize initiating a data lineage process. You’re planning a data system migration. The data preparation.

Visualization 89

Visualization Metrics Reporting Software 89

Octopai

MARCH 24, 2022

That’s why we at Octopai were so gratified to be awarded the A-Team’s 2022 “Most Innovative Data Lineage Solution” award. The A-Team is a knowledge platform for financial markets, providing in-depth resources across all aspects of regulation, enterprise data management and trading technology. Go for cross-system lineage. .

Reporting 92

Reporting Visualization Marketing Technology 92

Alation

AUGUST 18, 2022

How do you approach data lineage? We all know that data lineage is a complex and challenging topic. In this blog, I am drilling into something I’ve been thinking about and studying for a long time: fundamental approaches to lineage creation and maintenance. What Is Data Lineage Creation & Maintenance?

Metadata 69

Metadata Visualization Statistics Data Architecture 69

Octopai

MARCH 23, 2022

Dirty Meat… and Dirty Data. But even though “dirty meat” is a small concern, “dirty data” is the scourge of any industry that relies heavily on information systems. While “dirty data” doesn’t sound as threatening as “dirty meat” (after all, it’s your computer ingesting it, not you), don’t be deceived. Cleaning Up Dirty Data.

Data Quality 91

Data Quality Reporting Modeling Interactive 91

Octopai

MARCH 22, 2021

Snowflake can be the answer to all your data wishes. Elimination of data silos, consistency, accessibility, reliability, scalability, power of the cloud…. Data lineage is one of the key tools you can utilize to get the most out of Snowflake and stop all that headbanging. Cleaning up dirty data. Download the eBook.

Data Lake 92

Data Lake Metadata Data Warehouse Reporting 92

Octopai

DECEMBER 11, 2022

Data compliance may be good tidings for consumers, customers and clients, but it’s a big pain in the neck for the organizations that need to comply. Let’s take a look at several regulatory standards and explore automated data lineage’s role in smoothing and improving data compliance. Can you find all that data?

Insurance 52

Insurance Risk Metadata Reporting 52

Octopai

SEPTEMBER 30, 2020

This error required fixing, which meant that he and his team would have to trace the data’s journey back to its source. He quickly rounded up his team of analysts and they immediately began mapping the data lineage of the specific data point in order to determine where the inconsistency was made. Download the White Paper.

Reporting 89

Reporting Cost-Benefit Visualization Business Intelligence 89

Octopai

NOVEMBER 13, 2022

The modern data stack is a data management system built out of cloud-based data systems. A given modern data stack will usually include components for data ingestion from your data sources, data transformation, data storage, data analysis and reporting.

Enterprise 77

Enterprise Data Warehouse Reporting Metadata 77

Octopai

FEBRUARY 24, 2021

Change is usually incremental: migrating all that data is a slow process, not done all at once so you inevitably have your foot in the old system and the new one at the same time – for a loooooong time. Data and metadata are the glue that connects all these different hybrid system components. The Magic of Data Lineage.

Metadata 84

Metadata Reporting Data Governance Management 84

Octopai

JANUARY 20, 2022

But while going-off-the-grid-and-becoming-untraceable might be wonderful for some human folks, it’s not what you want happening to your data. When data goes off the grid. And it doesn’t – if you have data lineage software. Data lineage software is the ultimate tracker and tracer for your data.

Software 92

Software IT Data-driven Enterprise 92

Octopai

MAY 9, 2021

Data lineage is also a tool. Different business intelligence jobs require different kinds of data lineage. The type of lineage that a BI Developer would use to perform root cause analysis is not the same type of lineage that the Data Engineer would use to do data flow visualization inside of an ETL process.

Visualization 52

Visualization Reporting Business Intelligence Software 52

Octopai

FEBRUARY 9, 2023

Trying to manage data governance without a comprehensive data lineage solution can leave you feeling like your data keeps running away. It’s not easy to keep up with data and metadata on the move. A comprehensive data lineage tool is the secret weapon of successful data governance managers and data stewards.

Data Governance 52

Data Governance Metadata Data Quality Management 52

Octopai

JUNE 22, 2023

In the era of big data, organizations are grappling with the challenge of effectively managing and leveraging vast amounts of data. Two prominent approaches have emerged: self-service data management and centralized data management. This approach offers greater control and reduces the risk of data inconsistencies.

Management 52

Management Data-driven Data Quality Data Governance 52

Alation

FEBRUARY 7, 2023

That was my earliest taste of data lineage. It wouldn’t be until 2013 that the topic of data lineage would surface again – this time while working on a data warehouse project. Data warehouses obfuscate data’s origin In 2013, I was a Business Intelligence Engineer at a financial services company.

Metadata 52

Metadata Data Warehouse Visualization Data Quality 52

Octopai

DECEMBER 28, 2022

For most data analysts and end-users, the vast majority of data activity is spent in the zoomed-in view of their data environment: analytics and reporting. Power BI is a robust data analytics and reporting platform, with the ability to draw in data from a variety of sources, then model, visualize and derive insights.

Reporting 52

Reporting Data Quality Visualization Data Warehouse 52

Octopai

JULY 9, 2020

Your Guide to Machine Learning Data Lineage for BI: From Source to Target. Too often, data lineage is considered a linear course that does little more than reveal the route data took to arrive at its final destination. Sick of all the manual mapping required to sort out inconsistencies in your data?

Insurance 86

Insurance Risk Management Machine Learning Metadata 86

erwin

AUGUST 7, 2019

A data catalog benefits organizations in a myriad of ways. With the right data catalog tool, organizations can automate enterprise metadata management – including data cataloging, data mapping, data quality and code generation for faster time to value and greater accuracy for data movement and/or deployment projects.

Metadata 90

Metadata Data Governance Data Quality Data Warehouse 90

Dataiku

APRIL 28, 2023

This article is based on the 2022 Dataiku Frontrunner Awards submission from Snow Fox Data, a division of Excelion Partners. As one of our top consulting partners, Snow Fox Data works with numerous customers who utilize Dataiku in their data science and analytics practice.

Consulting 52

Consulting Data Science Strategy Analytics 52

Alation

AUGUST 20, 2020

The post Alation and Manta: Automating Advanced Data Lineage appeared first on Alation.

Data Quality 98

Data Quality 98

Octopai

JANUARY 31, 2021

Data lineage is an essential tool that among other benefits, can transform insights, help BI teams understand the root cause of an issue, as well as help achieve and maintain compliance. Through the use of data lineage, companies can better understand their data and its journey. Data Engineering Podcast.

Data Governance 57

Data Governance Data Processing Data Quality Metadata 57

Octopai

DECEMBER 30, 2020

In the financial industry, data lineage (i.e Here Are the Top 5 Reasons Why Financial Institutions Need Automated Data Lineage. A strong data lineage solution is a critical partner in this effort. Want to Make Sure Your Data Lineage is Ready for 2021? It’s not a joke. It’s a must-have.

Finance 63

Finance Reporting Modeling Risk 63

Octopai

JUNE 21, 2021

And just like data intelligence was critical for your financial institution’s success with Basel IV , so it is critical for FRTB regulatory compliance and all BCBS 239 compliance. Backtesting their model with real pricing and holdings data dating back to 2007. You’ve Got a Friend in Automated Data Lineage!

Risk 52

Risk Measurement Modeling Reporting 52

Octopai

OCTOBER 22, 2020

Where did the data in this report come from? Whether it be banking, healthcare, education, or SaaS, companies constantly wonder about the validity of their data. So, how can BI and analytics teams truly prove that the data can be trusted? They looked at the importance of automated data lineage and how crucial it is for BI teams.

Visualization 60

Visualization Data-driven Strategy Reporting 60

Aryng

JULY 31, 2021

Like animals and plants, data too has a life cycle. When dealing data maturity – that helps maintain high standard data quality – it is necessary for organizations to understand the life cycle of data. It goes through various changes from its inception to its destination.

Data Quality 52

Data Quality IT Data Governance Data Science 52

Jen Stirrup

OCTOBER 28, 2019

The Microsoft Power BI team have released a preview Data Lineage feature and it is a good start for organizations who are starting to think about data management. The Power BI lineage view displays the lineage relationships between all the artifacts in a workspace, and all its external dependencies.

IT 85

IT Business Intelligence Data Governance ROI 85

Octopai

SEPTEMBER 10, 2020

It usually goes something like this: “Using state-of-the-art tools and techniques, leveraging your creativity and understanding of business operations and data structures to combine data from disparate sources to generate reports, dashboards, and other deliverables to provide actionable business insights to key stakeholders.

Business Intelligence 52

Business Intelligence Data Warehouse Dashboards Reporting 52

Octopai

MAY 30, 2021

Data lineage by any other name… would still be data lineage. questions at your company, you are invariably doing or in need of doing some type of data lineage. For every BI team, however, there comes a point when it makes sense to be more systematic about your data lineage.

Reporting 52

Reporting KPI Business Intelligence Management 52

Octopai

JANUARY 21, 2020

How much time has your BI team wasted on finding data and creating metadata management reports? In fact, BI projects used to take many months to complete and require huge numbers of IT professionals to extract data. However, over time new technologies and tools developed to ease data reporting and analysis.

OLAP 56

OLAP Metadata Online Analytical Processing Data Quality 56