November 17, 2019

219 words 2 mins read

Data services: Processing big data the microservice way

Data services: Processing big data the microservice way

Mario-Leander Reimer explores key JEE technologies that can be used to build JEE-powered data services and walks you through implementing the individual data processing tasks of a simplified showcase application. You'll then deploy and orchestrate the individual data services using OpenShift, illustrating the scalability of the overall processing pipeline.
Talk Title Data services: Processing big data the microservice way
Speakers Mario-Leander Reimer (QAware)
Conference O’Reilly Software Architecture Conference
Conf Tag Engineering the Future of Software
Location New York, New York
Date February 26-28, 2018
URL Talk Page
Slides Talk Slides
Video

Big data processing, microservices, and cloud-native technology are a match made in computing heaven, enabling microservices to be used to build a flexible, scalable, and distributed system of loosely coupled data processing tasks, called data services. Mario-Leander Reimer explores key JEE technologies that can be used to build JEE-powered data services and walks you through implementing the individual data processing tasks of a simplified showcase application. You’ll then deploy and orchestrate the individual data services using OpenShift, illustrating the scalability of the overall processing pipeline. The context and content is taken from a real-world project for a major German car manufacturer, implementing a microservices-based processing pipeline that uses car-related event data (sensor data, traffic events, and other real-time data) for a traffic information management and route optimization system.

management microservice openshift big data distributed system optimization cloud scalable pipeline
comments powered by Disqus
Complex event flows in distributed systems

Complex event flows in distributed systems

November 17, 2019

In distributed systems, some business transactions and even more end-to-end processes stretch across boundaries of individual services. While event-driven choreography leads to nicely decoupled systems, complex event chains cause headaches. Bernd Rcker explains why transforming certain events into commands is beneficial and how to avoid losing sight of larger-scale flows.
Enterprise architecting for digital disruption

Enterprise architecting for digital disruption

November 16, 2019

The catchphrase of the year is digital disruption. It's finally clear that digital complacency is a path to nonexistence even in industries that havent yet felt the direct impact of the digital era. Joel Crabb explains why retail has been completely disrupted and, in the process, is reinventing enterprise architecture for digital relevancy.
The architect as strategist

The architect as strategist

November 13, 2019

Eben Hewitt explains what the worlds top strategy firms can teach us about the intersection of strategic thinking and architecture and outlines a framework, process, and set of tools that will help you create a powerful technology strategy for your organization.
Building stream processing as a service at Netflix

Building stream processing as a service at Netflix

November 17, 2019

Steven Wu explains how Netflixs SPaaS platform empowers users to focus on extracting insights from data streams and build stream processing applications and shares lessons learned building and operating the largest SPaaS use case: Netflixs Keystone data pipeline, a self-serve platform for creating near-real-time event pipelines that processes three trillion events and 12 PB of data every day.
Cloud-native deployment options: A review of container, serverless, and microservice implementations (sponsored by IBM)

Cloud-native deployment options: A review of container, serverless, and microservice implementations (sponsored by IBM)

November 17, 2019

Whether youre modernizing an application monolith or developing a new cloud-native application, it's no longer a question of whether or not to use microservices. Instead, the challenge facing many architects is deciding what technologies to use in their applications. Andrew Hately details the best combination of cloud services and tools to use to get the right results.
Considerations and pitfalls when migrating from on-premises to the public cloud (sponsored by ThoughtWorks)

Considerations and pitfalls when migrating from on-premises to the public cloud (sponsored by ThoughtWorks)

November 17, 2019

Cassandra Shum and Rosemary Wang detail what you need to know when moving from an on-premises platform to the public cloud, moving beyond the technical architecture and patterns to explore the pitfalls when migrating.