From legacy to cloud: An end-to-end data integration journey
Max Schultze details Zalondo's end-to-end data integration platform to serve analytical use cases and machine learning throughout the company, covering raw data collection, standardized data preparation (binary conversion, partitioning, etc.), user-driven analytics, and machine learning.
Talk Title | From legacy to cloud: An end-to-end data integration journey |
Speakers | Max Schultze (Zalando SE) |
Conference | Strata Data Conference |
Conf Tag | Making Data Work |
Location | London, United Kingdom |
Date | April 30-May 2, 2019 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Transitioning a full company to the cloud is hard. Starting a data lake halfway through is even harder. Integrating data sources from both cloud and legacy data centers has to be done tailored to the past with the future in mind. Max Schultze details Zalondo’s end-to-end data integration platform to serve analytical use cases and machine learning throughout the company, covering raw data collection, standardized data preparation (binary conversion, partitioning, etc.), user-driven analytics, and machine learning. Along the way, he shares the technical challenges and lessons learned building and operating data pipelines and computation as a service for hundreds of teams operating at petabyte scale.