The Path to GPU as a Service in Kubernetes

TLDR: Kubernetes modern production patterns for Deep Learning applications and a deep dive into the Kubernetes GPU and Hardware accelerators subsystem and its challenges (performance, scheduling, mon …

TLDR: Kubernetes modern production patterns for Deep Learning applications and a deep dive into the Kubernetes GPU and Hardware accelerators subsystem and it’s challenges (performance, scheduling, monitoring).Autonomous vehicles, face recognition, High Performance Computing, Virtual Reality, NVIDIA GPUs are enabling a new computer era with cloud computing at its center. With kubernetes being the next iteration in cloud technologies, the NVIDIA container team is driving with the community the advances in GPU integration.During this talk we will take a look at the possibilities and limitations provided by the kubernetes infrastructure for hardware accelerators. We will also be discussing the latest improvements in the device plugin subsystem of Kubernetes, powering GPU support, and the challenges ahead of it.