Running a massively parallel stream processing system at Netflix

Keystone, a critical piece of Netflix's backend data infrastructure, ensures massive data movements and real-time event processing. Zhenzhong Xu leads a deep dive into Keystone's architecture and underlying stream processing engines, sharing insights and proven paths on how the company achieves multitenancy, scalability, and resilience in a complex cloud-native distributed system environment.

Over 200 million devices worldwide are capable of streaming Netflix content. Sitting on top of a microservice architecture, the entire ecosystem generates more than a trillion events each day to feed critical Netflix systems to monitor service health, detect fraudulent behaviors, improve customer experience, etc. Keystone, a critical piece of Netflix’s backend data infrastructure, ensures a massive amount of events are delivered in near real time reliably, at scale, and in the face of failures. Zhenzhong Xu leads a deep dive into Keystone’s architecture and underlying stream processing engines, sharing insights and proven paths on how the company achieves multitenancy, scalability, and resilience in a complex cloud-native distributed system environment.