December 3, 2019

168 words 1 min read

Efficient IoT with Protocol Buffers and gRPC

Efficient IoT with Protocol Buffers and gRPC

Building IoT applications that scales with a variety of devices and capabilities, such as network bandwidth, processor, and power consumption, can be a challenge. Furthermore, this can be complicated …
Talk Title Efficient IoT with Protocol Buffers and gRPC
Speakers Vladimir Vivien (Software Engineer, VMware)
Conference KubeCon + CloudNativeCon Europe
Conf Tag
Location Copenhagen, Denmark
Date Apr 30-May 4, 2018
URL Talk Page
Slides Talk Slides
Video

Building IoT applications that scales with a variety of devices and capabilities, such as network bandwidth, processor, and power consumption, can be a challenge. Furthermore, this can be complicated with a heterogenous development environment with a multitude of languages, communication frameworks, and protocols. This talk discusses how Protocol Buffers, a language and platform neutral serialization mechanism, can be used as an efficient protocol for small embedded devices with constrained bandwidth and power. We will demonstrate how gRPC, along with Protocol Buffers, provides a performant communication framework that can be used across diverse languages and device platforms to create realtime IoT applications.

grpc framework embedded network iot
comments powered by Disqus
Accelerating deep learning on Apache Spark using BigDL with coarse-grained scheduling

Accelerating deep learning on Apache Spark using BigDL with coarse-grained scheduling

November 30, 2019

The BigDL framework scales deep learning for large datasets using Apache Spark. However there is significant scheduling overhead from Spark when running BigDL at large scale. Shivaram Venkataraman and Sergey Ermolin outline a new parameter manager implementation that along with coarse-grained scheduling can provide significant speedups for deep learning models like Inception and VGG.
Automatic 3D MRI knee damage classification with 3D CNN using BigDL on Spark

Automatic 3D MRI knee damage classification with 3D CNN using BigDL on Spark

November 29, 2019

Damage to the meniscus is a physically limiting injury that can lead to further medical complications. Automatically classifying this damage at the time of an MRI scan would allow quicker and more accurate diagnosis. Jennie Wang, Valentina Pedoia, Berk Norman, and Yulia Tell offer an overview of their classification system built with 3D convolutional neural networks using BigDL on Apache Spark.
Distributed clinical models: Inference without sharing patient data

Distributed clinical models: Inference without sharing patient data

November 26, 2019

Clinical collaboration benefits from pooling data to train models from large datasets, but it's hampered by concerns about sharing data. Balasubramanian Narasimhan, John-Mark Agosta, and Philip Lavori outline a privacy-preserving alternative that creates statistical models equivalent to one from the entire dataset.
Envoy Internals Deep Dive

Envoy Internals Deep Dive

November 25, 2019

Envoy (https://www.envoyproxy.io/) is a high performance L4/L7 network proxy with a pluggable filter chain model; this allows Envoy to be used for a variety of different scenarios, including HTTP/2, g …
Improving user-merchant propensity modeling using neural collaborative filtering and wide and deep models on Spark BigDL at scale

Improving user-merchant propensity modeling using neural collaborative filtering and wide and deep models on Spark BigDL at scale

November 24, 2019

Sergey Ermolin and Suqiang Song demonstrate how to use Spark BigDL wide and deep and neural collaborative filtering (NCF) algorithms to predict a users probability of shopping at a particular offer merchant during a campaign period. Along the way, they compare the deep learning results with those obtained by MLlibs alternating least squares (ALS) approach.
Cloud Native Networking for Containers in AWS using CNI Plugins

Cloud Native Networking for Containers in AWS using CNI Plugins

November 23, 2019

The Container networking interface (CNI) project makes it really simple for container orchestrators to configure networking for containers. In this presentation, Anirudh Aithal will provide a detailed …