November 5, 2019

181 words 1 min read

Scalable bidirectional communication over the Web

Scalable bidirectional communication over the Web

Recent advances in transports and frameworks have made it possible to deploy large-scale, low-latency bidirectional communication over HTTP without losing original benefits like scalability and safety. Wenbo Zhu offers an overview of the use cases for enabling bidirectional communication as well as a demo that runs a distributed, shared whiteboard application from a browser.
Talk Title Scalable bidirectional communication over the Web
Speakers Wenbo Zhu (Google)
Conference O’Reilly Open Source Convention
Conf Tag
Location Austin, Texas
Date May 16-19, 2016
URL Talk Page
Slides Talk Slides
Video

Recent advances in transports and frameworks have made it possible to deploy large-scale, low-latency bidirectional communication over HTTP without losing original benefits like scalability and safety. Wenbo Zhu offers a high-level overview of the use cases for enabling bidirectional communication over the Web and over HTTP and provides a detailed analysis of several key scalability issues, including flow control, async APIs, reliability, multihoming support, and safety, as well as a demo that runs a distributed and shared whiteboard application from a browser. Related resources: Open source client Bidiweb GitHub Implications of Full-Duplex HTTP (article)

api safe reliability framework github large-scale open source use case scalable
comments powered by Disqus
Designing a reactive data platform: Challenges, patterns, and antipatterns

Designing a reactive data platform: Challenges, patterns, and antipatterns

November 1, 2019

Extracting value from data goes beyond robust ingestion pipelines and flexible storage. A solid data architecture addresses the needs of analysts and engineers by providing a simple, self-service ecosystem capable of handling any workload. Alex Silva discusses how the platform team at Pluralsight has been conquering these challenges by designing a platform using distributed, reactive services.
Building a scalable data science platform with R

Building a scalable data science platform with R

October 27, 2019

Hadoop is famously scalable, as is cloud computing. R, the thriving and extensible open source data science software. . .not so much. Mario Inchiosa and Roni Burd outline how to seamlessly combine Hadoop, cloud computing, and R to create a scalable data science platform that lets you explore, transform, model, and score data at any scale from the comfort of your favorite R environment.
IoT in the enterprise: A look at Intel (IoT) Inside

IoT in the enterprise: A look at Intel (IoT) Inside

October 23, 2019

Moty Fania shares Intels IT experience implementing an on-premises big data IoT platform for internal use cases. This unique platform was built on top of several open source technologies and enables highly scalable stream analytics with a stack of algorithms such as multisensor change detection, anomaly detection, and more.
Scala and the JVM as a big data platform: Lessons from Apache Spark

Scala and the JVM as a big data platform: Lessons from Apache Spark

October 21, 2019

The success of Apache Spark is bringing developers to Scala. For big data, the JVM uses memory inefficiently, causing significant GC challenges. Spark's Project Tungsten fixes these problems with custom data layouts and code generation. Dean Wampler gives an overview of Spark, explaining ongoing improvements and what we should do to improve Scala and the JVM for big data.
TensorFlow: Large-scale analytics and distributed machine learning with TensorFlow, BigQuery, and Dataflow (Apache Beam)

TensorFlow: Large-scale analytics and distributed machine learning with TensorFlow, BigQuery, and Dataflow (Apache Beam)

October 20, 2019

Kazunori Sato and Amy Unruh explore how you can use TensorFlow to drive large-scale distributed machine learning against your analytic data sitting in Google BigQuery, with data preprocessing driven by Dataflow (now Apache Beam). Kazunori and Amy dive into practical examples of how these technologies can work together to enable a powerful workflow for distributed machine learning.
TensorFlow: Machine learning for everyone

TensorFlow: Machine learning for everyone

October 20, 2019

TensorFlow is an open source software library for numerical computation with a focus on machine learning. Rajat Monga offers an introduction to TensorFlow and explains how to use it to train and deploy machine-learning models to make your next application smarter.