Remove 2017 Remove Blog Remove Experimentation Remove Testing
article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

This blog post discusses such a comprehensive approach that is used at Youtube. To find optimal values of two parameters experimentally, the obvious strategy would be to experiment with and update them in separate, sequential stages. And we can keep repeating this approach, relying on intuition and luck.

article thumbnail

Some highlights from 2020

Data Science and Beyond

I’ve been working remotely with Automattic since 2017, so I was pretty covid-ready as far as work was concerned. I summarised this work in a post on the company’s blog , and discussed it in an interview with PublishPress. Remote work. This aligns well with my long-standing interest in causal inference.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

Another reason to use ramp-up is to test if a website's infrastructure can handle deploying a new arm to all of its users. The website wants to make sure they have the infrastructure to handle the feature while testing if engagement increases enough to justify the infrastructure. We offer two examples where this may be the case.

article thumbnail

What Are ChatGPT and Its Friends?

O'Reilly on Data

All of these models are based on a technology called Transformers , which was invented by Google Research and Google Brain in 2017. It’s by far the most convincing example of a conversation with a machine; it has certainly passed the Turing test. That’s either the most or the least important question to ask.

IT 262
article thumbnail

Themes and Conferences per Pacoid, Episode 9

Domino Data Lab

Finale Doshi-Velez, Been Kim (2017-02-28) ; see also the Domino blog article about TCAV. Adrian Weller (2017-07-29). “ They also require advanced skills in statistics, experimental design, causal inference, and so on – more than most data science teams will have. Challenges for Transparency ”. Riccardo Guidotti, et al.

article thumbnail

Real-Real-World Programming with ChatGPT

O'Reilly on Data

So far I’ve read a gazillion blog posts about people’s experiences with these AI coding assistance tools. Swift Papers felt like a well-scoped project to test how well AI handles a realistic yet manageable real-world programming task. This choice also inspired me to call my project Swift Papers.

article thumbnail

The trinity of errors in applying confidence intervals: An exploration using Statsmodels

O'Reilly on Data

Recall from my previous blog post that all financial models are at the mercy of the Trinity of Errors , namely: errors in model specifications, errors in model parameter estimates, and errors resulting from the failure of a model to adapt to structural changes in its environment. Indeed, we do present a key in this blog post.