Build an Event Driven Machine Learning Pipeline on Kubernetes
AIOps as a field is becoming the need of the hour. With various Machine Learning capabilities coming in different open source projects, and pipelines being built, having a transparent AI pipeline whic …
| Talk Title | Build an Event Driven Machine Learning Pipeline on Kubernetes |
| Speakers | Animesh Singh (Chief Architect and Program Director, IBM), Hou Gang, Liu (Advisory Software Developer, IBM) |
| Conference | KubeCon + CloudNativeCon |
| Conf Tag | |
| Location | Shanghai, China |
| Date | Jun 23-26, 2019 |
| URL | Talk Page |
| Slides | Talk Slides |
| Video | |
AIOps as a field is becoming the need of the hour. With various Machine Learning capabilities coming in different open source projects, and pipelines being built, having a transparent AI pipeline which can notify users of any data drift, bias detection, model accuracy loss etc. is becoming key. In addition, we need capabilities to build a Data Scientists code from source, orchestrate the code, and automate the pipeline. In this talk we will leverage Kubernetes components like build, eventing, serving and pipelines to show how to build an end to end AI pipeline which we detect any events happening, notify and take actions, can build and run data scientists code, do A/B testing, dark launch, and orchestrate the whole workflow from Model training, validation, serving, and operations. We will focus primarily on eventing and pipeline CRDs from Kubernetes to show this can be automated.
