INDUSTRY KEYNOTE
Martin Tingley

Netflix aims to continually improve the experience of its current and prospective members, and relies on a culture of experimentation to gauge and drive progress. As a result, the analyses and insights generated by its internal Experimentation Platform play a significant role in myriad strategic and operational decisions. In this talk, I will give an overview of the role of experimentation at Netflix, and how our internal Experimentation Platform is designed to both handle the high throughput of large experiments that we conduct, and to support innovations in metrics design and measurement methodology from our data scientists. I’ll then cover some of our latest methodology work on always-valid inference, highlighting how this work aligns the inference techniques we emphasize on our Experimentation Platform with the practices of the experimentation community at Netflix.