Machine Learning Made Easy on Kubernetes. DevOps for Data Scientists
Though machine learning and AI are immensely powerful, these solutions are by no means easy. In many cases, there are many diverse components that are not designed to work together. Additionally, thes …
Talk Title | Machine Learning Made Easy on Kubernetes. DevOps for Data Scientists |
Speakers | Brian Redmond (Cloud Architect, Microsoft) |
Conference | Open Source Summit + ELC Europe |
Conf Tag | |
Location | Edinburgh, UK |
Date | Oct 21-25, 2018 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Though machine learning and AI are immensely powerful, these solutions are by no means easy. In many cases, there are many diverse components that are not designed to work together. Additionally, these models are most efficient when running on large scale clusters that can be more difficult to manage. Configuration and deployment is often left to data scientists who are wasting time on infrastructure and not on data science itself. Kubernetes to the rescue! In this session I will talk about how machine learning can be greatly improved by implementing ML solutions on top of Kubernetes with containers. I will include demos of big data and machine learning workflows with solutions such as Kubeflow (Tensorflow, JupyterHub), Apache Spark, and Kubernetes of course. This talk is for both data scientists and infrastructure/SRE teams alike helping bring the benefits of DevOps to AI and machine learning.