article thumbnail

Experiment design and modeling for long-term studies in ads

The Unofficial Google Data Science Blog

Nevertheless, A/B testing has challenges and blind spots, such as: the difficulty of identifying suitable metrics that give "works well" a measurable meaning. Recently, we presented some basic insights from our effort to measure and predict long-term effects at KDD 2015 [1]. 2] Ron Kohavi, Randal M.

article thumbnail

Explaining black-box models using attribute importance, PDPs, and LIME

Domino Data Lab

Because of its architecture, intrinsically explainable ANNs can be optimised not just on its prediction performance, but also on its explainability metric. 2015) for additional details. Conference on Knowledge Discovery and Data Mining, pp. def create_model(): sgd = optimizers.SGD(lr=0.01, decay=0, momentum=0.9,

Modeling 139