article thumbnail

What is a DataOps Engineer?

DataKitchen

The data organization wants to run the Value Pipeline as robustly as a six sigma factory, and it must be able to implement and deploy process improvements as rapidly as a Silicon Valley start-up. The data engineer builds data transformations. Their product is the data. Read out Free E-book: The DataOps Cookbook.

Testing 152
article thumbnail

The 5 Data Mapping Steps Involved in a Data Migration

Octopai

You would like all of Amy’s books, toys and clothing from the old girls’ room to be put directly into her designated new room at the new house. It all happens through the magic of data transformation. Data transformation can include: Aggregation Discretization Generalization Conversion Normalization Filtering Smoothing.

Testing 52
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Self-Service Data’s New Frontier: The Data Catalog

Alation

For ease of understanding the differences between all of the them Rita shared this visual, categorizing the vendors: So at least for now, it looks like we’re a self-service data prep vendor, which makes sense. Alation helps analysts find, understand and use their data. We’re clearly not talking your Mama’s data catalog here.)

article thumbnail

How Data Lineage Improves Data Compliance

Octopai

It’s for that reason that even as the first BCBS-239 implementation deadline came into effect a few years ago, McKinsey reported that one-third of Global Systemically Important Banks had focused on “documenting data lineage up to the level of provisioning data elements and including data transformation.”.

article thumbnail

7 Things All Successful Data Product Managers Have In Common

Alation

Many are subject matter experts for a particular kind of data, which enables them to spot anomalies in that data quickly, understand the root cause, and resolve the issue. Image Sourced from theproductmanager.com Further, they can quickly create helpful visualizations from the data they analyze.

article thumbnail

Manual Feature Engineering

Domino Data Lab

Many thanks to AWP Pearson for the permission to excerpt “Manual Feature Engineering: Manipulating Data for Fun and Profit” from the book, Machine Learning with Python for Everyone by Mark E. We discussed this as far back as Chapter 1 [in the book]. There is also a complementary Domino project available.

Testing 68
article thumbnail

Best Web Analytics 2.0 Tools: Quantitative, Qualitative, Life Saving!

Occam's Razor

As defined in my second book Web Analytics 2.0 the analysis of qualitative and quantitative data from your website and the competition, 2. For more on why I recommend this specific order please see my second book, Web Analytics 2.0 , which many of you already have. First Bit Of Context. Web Analytics 2.0. Fourth Bit Of Context.

Analytics 135