gpu

Deploying deep learning models on GPU-enabled Kubernetes clusters

Deploying deep learning models on GPU-enabled Kubernetes clusters

January 1, 2020

Interested in deep learning models and how to deploy them on Kubernetes at production scale? Not sure if you need to use GPUs or CPUs? Mathew Salvaris and Fidan Boylu Uz help you out by providing a step-by-step guide to creating a pretrained deep learning model, packaging it in a Docker container, and deploying as a web service on a Kubernetes cluster.
Deployment considerations and best practices for your AI workloads from Mastercard (sponsored by Dell Technologies)

Deployment considerations and best practices for your AI workloads from Mastercard (sponsored by Dell Technologies)

January 1, 2020

There are many different decisions to make when choosing the right solutions and infrastructure. Drawing on real-world considerations, use cases, and solutions, Nick Curcuru discusses different decisionsand the associated considerations and best practicesMastercard exercised to build and deploy a successful AI.
Lightning Talk: Sharing a GPU Among Multiple Containers

Lightning Talk: Sharing a GPU Among Multiple Containers

December 24, 2019

Weve been sharing GPU resources across multiple containers since 2016, and weve learned a few lessons along the way. In this lightning talk, well walk you through the work weve done and discuss so …
Measuring and Optimizing Kubeflow Clusters at Lyft

Measuring and Optimizing Kubeflow Clusters at Lyft

December 13, 2019

Machine learning workloads are often resource-intensive operations. As companies adopt more of these workloads, tracking resource consumption and optimizing spending becomes more challenging.At Lyft, …
KubeFlows Serverless Component: 10x Faster, a 1/10 of the Effort

KubeFlows Serverless Component: 10x Faster, a 1/10 of the Effort

December 12, 2019

Serverless simplifies data science by automating the process of code to container and enables users to add instrumentation and auto-scaling with minimum overhead. However, serverless has many limitati …
KubeVirt Deep Dive: Virtualized GPU Workloads on KubeVirt

KubeVirt Deep Dive: Virtualized GPU Workloads on KubeVirt

December 10, 2019

KubeVirt is a Kubernetes extension that supports running traditional Virtual Machine workloads side by side with containers.In this session we will explore the architecture behind KubeVirt and how NVI …
Networking Optimizations for Multi-Node Deep Learning on Kubernetes

Networking Optimizations for Multi-Node Deep Learning on Kubernetes

November 24, 2019

Training a Neural Network may take days or weeks, even on a top of the line GPU. To reduce training time, distributed computation is often employed to spread the work across multiple GPUs and multiple …
GPU as a Service Over K8s: Drive Productivity and Increase Utilization

GPU as a Service Over K8s: Drive Productivity and Increase Utilization

November 21, 2019

Building machine learning applications is hard. Surprisingly enough, its not the data science thats hard, but all the operations around it. GPUs accelerate performance, but pose challenges such as G …
Supercharge Kubeflow Performance on GPU Clusters

Supercharge Kubeflow Performance on GPU Clusters

November 19, 2019

AI/ML applications on Kubernetes can be optimized for performance at many levels.This presentation provides an overview of the optimizations such as:- Distributed training on multiple GPUs with optima …
GPU Machine Learning From Laptop to Cloud

GPU Machine Learning From Laptop to Cloud

November 7, 2019

In this session Mark will talk about how to setup and build containers to run GPU accelerated Machine Learning workloads on your laptop and move these easily to cloud. The session will cover setting u …
Building HA Multi-Cloud Clusters Using WireGuard as a Network Overlay

Building HA Multi-Cloud Clusters Using WireGuard as a Network Overlay

November 6, 2019

Kubernetes abstracts away infrastructure, enabling the community to leverage a single, powerful interface anywhere we like, from bare-metal to public clouds like AWS or GCP. However, not all infrastru …
Panel Discussion: Democratizing HPC & AI: Startups Scale Up with Cloud Native

Panel Discussion: Democratizing HPC & AI: Startups Scale Up with Cloud Native

November 2, 2019

Innovativeness, resourcefulness, and responsiveness are all part of the startup DNA, and with the aid of the cloud native era and ecosystem, they are unstoppable. Hear how these European startups are …
Large Scale Distributed Deep Learning with Kubernetes Operators

Large Scale Distributed Deep Learning with Kubernetes Operators

October 29, 2019

The focus of this talk is the usage of Kubernetes operators to manage and automate training process for machine learning tasks. Two open source Kubernetes operators, tf-operator and mpi-operator, will …
Production GPU Cluster with K8s for AI and DL Workloads

Production GPU Cluster with K8s for AI and DL Workloads

October 25, 2019

We will present NVIDIA's experience in building and operating a production GPU cluster with K8s for AI/DL and HPC workloads. Running GPU accelerated workloads in K8s has unique challenges, and we'll d …
Running eBays High-Performance Workloads with Kubernetes

Running eBays High-Performance Workloads with Kubernetes

October 25, 2019

In the past two years weve been expanding our k8s deployments significantly fast by moving more and more production workloads into kubernetes.Were now running multiple thousand-node k8s clusters fro …
Economics and Best Practices of Running AI/ML Workloads on Kubernetes

Economics and Best Practices of Running AI/ML Workloads on Kubernetes

October 19, 2019

In this session, we will discuss how Kubernetes driven AI/ML building blocks are making AI/ML simple, fast and efficient for data scientists, data engineers, devops engineers and everyday users. We wi …
GPU Sharing for Machine Learning Workload on Kubernetes

GPU Sharing for Machine Learning Workload on Kubernetes

October 16, 2019

Machine learning is becoming more and more popular in the technology world. The community is beginning to leverage Kubernetes to deploy and manage the machine learning workload. One of the key challe …
Co-Location of CPU and GPU Workloads with High Resource Efficiency

Co-Location of CPU and GPU Workloads with High Resource Efficiency

October 9, 2019

Users run various workloads in Kubernetes including long running services and AI batch jobs. Normally, GPU machines are dedicated only for AI training and the resource utilization is low in some time. …
Large Scale Distributed Deep Learning on Kubernetes Clusters

Large Scale Distributed Deep Learning on Kubernetes Clusters

October 2, 2019

The focus of this talk is the deployments of large scale distributed deep learning with Kubernetes. The usage of operators to manage and automate training processes for machine learning are discussed. …
Minimizing GPU Cost for Your Deep Learning on Kubernetes

Minimizing GPU Cost for Your Deep Learning on Kubernetes

September 28, 2019

More and more data scientists run their Nvidia GPU based deep learning tasks on Kubernetes. Meanwhile, it's found over 40% cost are wasted on idle GPU in the cluster. So one important challenge is how …
Multi-Cloud Machine Learning Data and Workflow with Kubernetes

Multi-Cloud Machine Learning Data and Workflow with Kubernetes

September 27, 2019

Autonomous vehicles require hardware accelerated machine learning for critical problems such as tracking and classification. Momenta trains ML models in on-prem regions and public clouds, each comes w …
A Method for the Cost Optimization of Kubernetes-based Deep Learning Training and Inference

A Method for the Cost Optimization of Kubernetes-based Deep Learning Training and Inference

September 26, 2019

To improve the throughput capacity of the training or inference applications without adding extra GPU cores, we share one GPU core between multiple deep learning workloads in a kubernetes cluster by c …
Keynote: Tencent: Kubernetes in the Billions

Keynote: Tencent: Kubernetes in the Billions

September 24, 2019

At Tencent, our business touches everything from gaming, social media, payments, to cloud computing. Wed like to share our story of how K8s is broadly used at Tencent, taking care of our infrastructu …