Strange Loop

Experimentation: putting research papers into prod

Innovation happens when we apply concepts from research papers and put them into production. Taking complex ideas and applying them to a real world production environment requires one key step: online evaluation. Theory and offline evaluations can only take you so far, you have to evaluate ideas in an online controlled setting. The better your experimentation practices are, the better you will be at evaluating research in production settings. 

In this talk, we will zoom in on experimentation strategies from popular research papers that in theory, should really unlock innovation and the speed of experimenting but in practice, are hard to apply, why that's the case and what you can do to put research paper concepts into production.

Leemay Nassery

Engineering leader at Spotify

Leemay Nassery is an engineering leader at Spotify. She is also the author of Practical A/B Testing.