December 20, 2019

188 words 1 min read

Netra Q&A: Scaling resource-intensive APIs (sponsored by Oracle + Dyn)

Netra Q&A: Scaling resource-intensive APIs (sponsored by Oracle + Dyn)

Kyle York and Richard Lee explore Netras high-performance computing environment, focusing on how the company's AI and deep learning models process tens of millions of images and videos each day in a time- and cost-effective manner. Along the way, they explain what worked, what didn't, and why you need an Agile, hybrid infrastructure if you want to build an AI business at the scale of social.
Talk Title Netra Q&A: Scaling resource-intensive APIs (sponsored by Oracle + Dyn)
Speakers Kyle York (Oracle + Dyn), Richard Lee (Netra)
Conference O’Reilly Velocity Conference
Conf Tag Building and maintaining complex distributed systems
Location San Jose, California
Date June 12-14, 2018
URL Talk Page
Slides Talk Slides
Video

Kyle York and Richard Lee explore Netra’s high-performance computing environment, focusing on how the company’s AI and deep learning models process tens of millions of images and videos each day in a time- and cost-effective manner. Along the way, they explain what worked, what didn’t, and why you need an Agile, hybrid infrastructure if you want to build an AI business at the scale of social. This keynote is sponsored by Oracle + Dyn.

api agile infrastructure ai video deep learning performance
comments powered by Disqus
A high-performance system for deep learning inference and visual inspection

A high-performance system for deep learning inference and visual inspection

December 12, 2019

Moty Fania explains how Intel implemented an AI inference platform to enable internal visual inspection use cases and shares lessons learned along the way. The platform is based on open source technologies and was designed for real-time streaming and online actuation.
Encoding 250,000 Songs a Day with batch/v1 Jobs

Encoding 250,000 Songs a Day with batch/v1 Jobs

December 13, 2019

Tasked with rebuilding the way we deliver music to DJ's, the Beatport Infrastructure team set out to use Kubernetes to construct scalable compute for executing batch and on-demand encoding workloads i …
Distributed training of deep learning models

Distributed training of deep learning models

December 10, 2019

Mathew Salvaris, Miguel Gonzalez-Fierro, and Ilia Karmanov offer a comparison of two platforms for running distributed deep learning training in the cloud, using a ResNet network trained on the ImageNet dataset as an example. You'll examine the performance of each as the number of nodes scales and learn some tips and tricks as well as some pitfalls to watch out for.
Accelerating deep learning on Apache Spark using BigDL with coarse-grained scheduling

Accelerating deep learning on Apache Spark using BigDL with coarse-grained scheduling

November 30, 2019

The BigDL framework scales deep learning for large datasets using Apache Spark. However there is significant scheduling overhead from Spark when running BigDL at large scale. Shivaram Venkataraman and Sergey Ermolin outline a new parameter manager implementation that along with coarse-grained scheduling can provide significant speedups for deep learning models like Inception and VGG.
Deep learning-based search and recommendation systems using TensorFlow

Deep learning-based search and recommendation systems using TensorFlow

November 27, 2019

Abhishek Kumar and Vijay Srinivas Agneeswaran offer an introduction to deep learning-based recommendation and learning-to-rank systems using TensorFlow. You'll learn how to build a recommender system based on intent prediction using deep learning that is based on a real-world implementation for an ecommerce client.
The Path to GPU as a Service in Kubernetes

The Path to GPU as a Service in Kubernetes

November 26, 2019

TLDR: Kubernetes modern production patterns for Deep Learning applications and a deep dive into the Kubernetes GPU and Hardware accelerators subsystem and its challenges (performance, scheduling, mon …