The journey toward a self-service data platform at Netflix
The Netflix data platform is a massive-scale, cloud-only suite of tools and technologies. It includes big data tech (Spark and Flink), enabling services (federated metadata management), and machine learning support. But with power comes complexity. Kurt Brown explains how Netflix is working toward an easier, "self-service" data platform without sacrificing any enabling capabilities.
Talk Title | The journey toward a self-service data platform at Netflix |
Speakers | Kurt Brown (Netflix) |
Conference | Strata Data Conference |
Conf Tag | Big Data Expo |
Location | San Francisco, California |
Date | March 26-28, 2019 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
The Netflix data platform is a massive-scale, cloud-only suite of tools and technologies. It includes big data tech (Spark, Flink, Presto, and Druid), enabling services (federated metadata management and data event triggering), and machine learning support (end-to-end ML workflow infrastructure with notebook integration). But with power comes complexity. Kurt Brown explains how Netflix is working toward an easier, “self-service” data platform without sacrificing any enabling capabilities, diving into the philosophy, tactics, and technologies behind this transition. Join in to explore lessons learned and key principles to weave into your respective data worlds. Topics include: