Kudu is designed to fill the gap between HDFS and HBase. However, designing a Kudu-based cluster presents a number of challenges. Wei Chen and Zhaojuan Bian share a real-world use case from the automobile industry to explain how to design a Kudu-based E2E system. They also discuss key indicators to tune Kudu and OS parameters and how to select the best hardware components for different scenarios.

Data is a very important asset to LINE, one of the most popular messaging applications in Asia. Wataru Yukawa explains how LINE gets the most out of its data using a Hadoop data lake and an in-house log analysis platform.

The objectives of this security track are to provide: 1. a primer on the shared goals and incentives of operator groups and anti-abuse groups, 2. a review contempo …

To make sense of the bot development landscape, weve asked Amir Shevat, who runs developer relations at Slack, to give an overview of bot development tools from his perspective as a platform manager. He'll weigh the pros and cons of the popular bot frameworks and describe the strategic decisions that go into building the right bot stack.

Modern cars produce data. Lots of data. And Formula 1 cars produce more than their fair share. Ted Dunning presents a demo of how data streaming can be applied to the analytics problems posed by modern motorsports. Although he won't be bringing Formula 1 cars to the talk, Ted demonstrates a physics-based simulator to analyze realistic data from simulated cars.

The face of applications is changing, evolving into a continuous information experience where the interaction model is immersive, experiential, and multimodal. Stewart Nickolas discusses the set of architectural challenges this new interaction paradigm brings, from microservice-based conversations to service integration to deep learning systems that support conversational commerce.

DistributedLog is a high-performance replicated log service built on top of Apache BookKeeper that is the foundation of publish-subscribe at Twitter, serving traffic from transactional databases to real-time data analytic pipelines. Sijie Guo offers an overview of DistributedLog, detailing the technical decisions and challenges behind its creation and how it is used at Twitter.

Application messaging isnt newsolutions include IBM MQ, RabbitMQ, and ActiveMQ. Apache Kafka is a high-performance, high-scalability alternative that integrates well with Hadoop. Can modern distributed messaging systems like Kafka be considered a legacy replacement or is it purely complementary? Ted Dunning outlines Kafka's architectural benefits and tradeoffs to find the answer.

MQTT is a standards-based, lightweight pub/sub messaging protocol ideal for Internet of Things use cases. With implementations in a number of different languages, using MQTT in your applications is simple and straightforward. Ryan Baxter shows how to build an application that connects to an MQTT broker and can receive data fromand issue commands toa number of different IoT devices.