Building streaming applications with Kafka
Dean Wampler and Boris Lublinsky walk you through building several streaming microservices applications based on Kafka using Akka Streams and Kafka Streams for data processing. You'll explore the strengths and weaknesses of each tool, helping you choose the best tools for your needs, and contrast them with Spark Streaming and Flink, so you can determine when to choose them instead.
Talk Title | Building streaming applications with Kafka |
Speakers | Dean Wampler (Anyscale), Boris Lublinsky (Lightbend) |
Conference | O’Reilly Software Architecture Conference |
Conf Tag | Engineering the Future of Software |
Location | New York, New York |
Date | February 26-28, 2018 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Kafka Streams is purpose built for reading data from Kafka topics, processing it, and writing the results to new topics. With powerful stream and table abstractions and an exactly once capability, it supports a variety of common scenarios. Akka Streams emerged as a dataflow-centric abstraction for the Akka actors model, designed for general-purpose microservices. It supports a wider class of application problems and third-party integrations, so it’s less Kafka-centric. Dean Wampler and Boris Lublinsky walk you through building several streaming microservices applications based on Kafka using Akka Streams and Kafka Streams for data processing. You’ll explore the strengths and weaknesses of each tool, helping you choose the best tools for your needs, and contrast them with Spark Streaming and Flink, so you can determine when to choose them instead.