article thumbnail

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning. accounting for effects "orthogonal" to the randomization used in experimentation. accounting for effects "orthogonal" to the randomization used in experimentation.

article thumbnail

Sentry’s David Cramer on bootstrapping a unicorn

CIO Business Intelligence

Sentry was started as an open source project by David Cramer in 2008 to provide monitoring services for application developers. Tyson: You’re coming up to two years since you added Sentry’s ability to monitor for performance which has some pretty fine-grained metrics in terms of identifying where bottlenecks are located in code.

Software 104
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Web Analytics Segmentation: Do Or Die, There Is No Try!

Occam's Razor

So it was with absolute delight that I wrote a detailed post about the release of Advanced Segmentation feature in Google Analytics in Oct 2008: Google Analytics Releases Advanced Segmentation: Now Be A Ninja! But a typical set of metrics you'll evaluate will hopefully represent a spectrum of success, like for example.

Analytics 123
article thumbnail

Deep Learning Illustrated: Building Natural Language Processing Models

Domino Data Lab

We need to take a brief break from natural language-specific content here to introduce a metric that will come in handy in the next section of the chapter, when we will evaluate the performance of deep learning NLP models. Note: van der Maaten, L., & Hinton, G. Visualizing data using t-SNE. Example 11.9 The Area under the ROC Curve.