The Unofficial Google Data Science Blog

APRIL 23, 2024

the weight given to Likes in our video recommendation algorithm) while $Y$ is a vector of outcome measures such as different metrics of user experience (e.g., Taking measurements at parameter settings further from control parameter settings leads to a lower variance estimate of the slope of the line relating the metric to the parameter.

Experimentation 52

Experimentation Optimization Uncertainty Metrics 52

The Unofficial Google Data Science Blog

JULY 22, 2020

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. When there are changing assignment weights and time-based confounders, this complication must be considered either in the analysis or the experimental design.

Experimentation 95

Experimentation Statistics Testing Strategy 95

Domino Data Lab

MAY 8, 2019

Finale Doshi-Velez, Been Kim (2017-02-28) ; see also the Domino blog article about TCAV. Adrian Weller (2017-07-29). “ Visualizations are vital in data science work, with the caveat that the information that they convey may be 4-5 layers of abstraction away from the actual business process being measured. 2018-06-21).

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

O'Reilly on Data

MARCH 23, 2023

Many of these go slightly (but not very far) beyond your initial expectations: you can ask it to generate a list of terms for search engine optimization, you can ask it to generate a reading list on topics that you’re interested in. It was not optimized to provide correct responses. It has helped to write a book.

IT 262

IT Modeling Testing Risk 262

Domino Data Lab

FEBRUARY 4, 2019

Spoiler alert: a research field called curiosity-driven learning is emerging at the nexis of experimental cognitive psychology and industry use cases for machine learning, particularly in gaming AI. The ability to measure results (risk-reducing evidence). Ensure a culture that supports a steady process of learning and experimentation.

Data Science 66

Data Science Experimentation Data-driven Machine Learning 66

Occam's Razor

SEPTEMBER 15, 2014

Company UX leaders are happy to stink less by taking the sub-optimal path of responsive design, rather than create a mobile-unique experience (your customers tend to do different things on your desktop site than your mobile site!). Create a distinct mobile website and mobile app measurement strategies. Implement Cross-Device Tracking.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

FEBRUARY 28, 2017

The qualitative surveys measuring unhappiness went down even more than before. You are what you measure. Additionally, I passionately believe that optimal metrics help solve for more than an individual’s behavior. While not optimal, it was understandable given the evolutionary stage they were at.

Key Performance Indicator 106

Key Performance Indicator Metrics Measurement Advertising 106