Spark on Kubernetes: A case study from JD.com
Zhen Fan and Wei Ting Chen explain how JD.com uses Spark on Kubernetes in a production environment and why the company chose Spark on Kubernetes for its AI workloads. You'll learn how to run Spark with Kubernetes and gain an understanding of the advantages this provides.
| Talk Title | Spark on Kubernetes: A case study from JD.com |
| Speakers | Zhen Fan (JD.com), Wei Ting Chen (Intel Corporate) |
| Conference | Strata Data Conference |
| Conf Tag | Big Data Expo |
| Location | San Jose, California |
| Date | March 6-8, 2018 |
| URL | Talk Page |
| Slides | Talk Slides |
| Video | |
Docker helps to easily build, ship, and run your applications. There are several ways to run Spark with Docker. Spark on Kubernetes is one of the solutions to run Spark by using a native way like Spark on Yarn or Mesos. Zhen Fan and Wei Ting Chen explain how JD.com uses Spark on Kubernetes in a production environment and why the company chose Spark on Kubernetes for its AI workloads. You’ll learn how to run with Spark with Docker while using Kubernetes as a resource manager and gain an understanding of the advantages this provides. Topics include:
