scalable

Personalization at scale: Challenges and practical techniques

Personalization at scale: Challenges and practical techniques

February 4, 2020

Hagay Lupesko explores AI-powered personalization at Facebook and the challenges and practical techniques it applied to overcome these challenges. You'll learn about deep learning-based personalization modeling, scalable training, and the accompanying system design approaches that are applied in practice.
Practical insights into deep reinforcement learning

Practical insights into deep reinforcement learning

February 4, 2020

Sahika Genc dives deep into the current state-of-the-art techniques in deep reinforcement learning (DRL) for a variety of use cases. Reinforcement learning (RL) is an advanced machine learning (ML) technique that makes short-term decisions while optimizing for a longer-term goal through trial and error.
Ubers Journey to Scalable Container Builds

Ubers Journey to Scalable Container Builds

February 3, 2020

This talk will present in detail the long and windy path that Uber has been on over the past few years to containerize the thousands of microservices written by thousands of engineers.It will go throu …
The OS for AI: How serverless computing enables the next gen of machine learning

The OS for AI: How serverless computing enables the next gen of machine learning

February 2, 2020

ML has been advancing rapidly, but only a few contributors focus on the infrastructure and scaling challenges that come with it. Jonathan Peck explores why ML is a natural fit for serverless computing, a general architecture for scalable ML, and common issues when implementing on-demand scaling over GPU clusters, providing general solutions and a vision for the future of cloud-based ML.
Cadence: Developer Oriented Workflow Platform

Cadence: Developer Oriented Workflow Platform

January 31, 2020

Cadence is an open source workflow platform for building reliable and highly scalable distributed applications. It is applicable to very large set of use cases from infrastructure and ML/Data automati …
The OS for AI: How serverless computing enables the next gen of machine learning

The OS for AI: How serverless computing enables the next gen of machine learning

January 24, 2020

ML has been advancing rapidly, but only a few contributors focus on the infrastructure and scaling challenges that come with it. Jonathan Peck explores why ML is a natural fit for serverless computing, a general architecture for scalable ML, and common issues when implementing on-demand scaling over GPU clusters, providing general solutions and a vision for the future of cloud-based ML.
Using Kubeflow Pipelines for Building Machine Learning Pipelines

Using Kubeflow Pipelines for Building Machine Learning Pipelines

January 24, 2020

Kubeflow is an open-source project dedicated to making deployments of machine learning workflows on Kubernetes simple, portable and scalable. This session will focus on Kubeflow Pipelines, a platform …
(Unifying analytics and AI on big data for faster insights at scale)

(Unifying analytics and AI on big data for faster insights at scale)

January 22, 2020

Ziya Ma walks you through Intels scalable data insights strategy and related big data analytics and AI technologies such as Analytics Zooan end-to-end analytics and AI pipeline for developing full solutions with Apache Spark on Intel Xeon and Intel Optane DC Persistent Memory at scale. She highlights customers use cases and collaboration with industry leaders throughout.
Build a backend with TypeScript using Nest.js (sponsored by Square)

Build a backend with TypeScript using Nest.js (sponsored by Square)

January 22, 2020

TypeScript is overtaking the JavaScript world. Nest.js is a progressive Node.js framework for building efficient, reliable, and scalable server-side applications using TypeScript. It's modular, testable, and very similar in structure to Angular but built for backends. Richard Moot covers how Nest.js makes things better when building a TypeScript app.
Building serverless solutions that are resilient, scalable, and cost effective

Building serverless solutions that are resilient, scalable, and cost effective

January 22, 2020

Ruth Yakubu explores end-to-end serverless scenarios on Microsoft Azure Functions, Azure Cosmos DB, and Event Grid.
Introduction to JanusGraph

Introduction to JanusGraph

January 21, 2020

JanusGraph is a scalable graph database that is optimized to store and query graphs with billions of vertices and edges distributed across a multi-machine cluster. We'll share several uses cases from …
DigitalOcean's Use of OSS in a Fully Routed Datacenter

DigitalOcean's Use of OSS in a Fully Routed Datacenter

January 12, 2020

DO is undergoing a major overhaul of its droplet network infrastructure to carry traffic over a layer 3 (routed) network. This allows a more scalable, versatile, and fault tolerant cloud network with …
Real-time SQL stream processing at scale with Apache Kafka and KSQL

Real-time SQL stream processing at scale with Apache Kafka and KSQL

January 7, 2020

Robin Moffatt walks you through the architectural reasoning for Apache Kafka and the benefits of real-time integration. You'll then build a streaming data pipeline using nothing but your bare hands, Kafka Connect, and KSQL.
Scaling Impala: Common mistakes and best practices

Scaling Impala: Common mistakes and best practices

January 6, 2020

Apache Impala is an MPP SQL query engine for planet-scale queries. When set up and used properly, Impala is able to handle hundreds of nodes and tens of thousands of queries hourly. Manish Maheshwari explains how to avoid pitfalls in Impala configuration (memory limits, admission pools, metadata management, statistics), along with best practices and anti-patterns for end users or BI applications.
Stream, stream, stream: Different streaming methods with Spark and Kafka

Stream, stream, stream: Different streaming methods with Spark and Kafka

January 6, 2020

NMC (Nielsen Marketing Cloud) provides customers (both marketers and publishers) with real-time analytics tools to profile their target audiences. To achieve that, the company needs to ingest billions of events per day into its big data stores in a scalable, cost-efficient way. Itai Yaffe explains how NMC continuously transforms its data infrastructure to support these goals.
The changing face of ETL: Event-driven architectures for data engineers

The changing face of ETL: Event-driven architectures for data engineers

January 6, 2020

Robin Moffatt discusses the concepts of events, their relevance to software and data engineers, and their ability to unify architectures in a powerful way. Join in to learn why analytics, data integration, and ETL fit naturally into a streaming world. Along the way, Robin will lead a hands-on demonstration of these concepts in practice and commentary on the design choices made.
Unleashing Apache Kafka and TensorFlow in hybrid architectures

Unleashing Apache Kafka and TensorFlow in hybrid architectures

January 4, 2020

How do you leverage the flexibility and extreme scale of the public cloud and the Apache Kafka ecosystem to build scalable, mission-critical machine learning infrastructures that span multiple public cloudsor bridge your on-premises data center to the cloud? Join Kai Whner to learn how to use technologies such as TensorFlow with Kafkas open source ecosystem for machine learning infrastructures.
Simple, scalable, and sustainable: A methodical approach to AI adoption (sponsored by Accenture)

Simple, scalable, and sustainable: A methodical approach to AI adoption (sponsored by Accenture)

December 29, 2019

After crossing the first AI implementation milestone, leaders often ask, "Whats next?" Based on experience implementing AI-led automation for more than 100 clients, Accenture has developed an easy-to-use methodology for scaling and sustaining reliable AI solutions. Rajendra Prasad (RP) explains how leaders and change makers in large enterprises can make AI adoption successful.
DevOps for Networking

DevOps for Networking

December 28, 2019

To demonstrate the power of DevOps tool we have deployed a web-based ticket booking website using GIT, Ansible, Vagrant, Docker, Jenkins and Kubernetes.DevOps is a new methodology that combines devel …
Understanding and integrating Intel Deep Learning Boost (Intel DL Boost)

Understanding and integrating Intel Deep Learning Boost (Intel DL Boost)

December 28, 2019

Banu Nagasundaram offers an overview of Intel's Deep Learning Boost (Intel DL Boost) technology, featuring integer vector neural network instructions targeting future Intel Xeon scalable processors. Banu walks you through the 8-bit integer convolution implementation made in the Intel MKL-DNN library to demonstrate how this new instruction is used in optimized code.
VPP Accelerated High Performance & Scalable L3DSR L4 Load Balancer on Top Clos

VPP Accelerated High Performance & Scalable L3DSR L4 Load Balancer on Top Clos

December 28, 2019

Delivering fast packets is getting difficult under rapid increase of service endpoints at huge traffic large-scale data center.Especially, time to on-demand deployment of load balancing function neede …
Using machine learning to automate car damage assessment and document workflows

Using machine learning to automate car damage assessment and document workflows

December 27, 2019

Vladimir Starostenkov and Siarhei Sukhadolski discuss two ML solutions from Altoros: one was developed to facilitate the process of assessing car damage right at the accident scene, while the second helps to automate recognition, extraction, and analysis. Join in to see how to integrate both solutions into the existing workflows of insurance, car rental, and maintenance services.
Beyond Blockchains and Proof of Work

Beyond Blockchains and Proof of Work

December 25, 2019

At once revolutionary and also over-hyped, blockchains represent a dilemma: the underlying technology proposed to date is thoroughly incapable of living up to a fraction of the dream that has been sol …
Business Rules in a Microservices Architecture

Business Rules in a Microservices Architecture

December 25, 2019

Business Rules and Machine Learning Model predictions generally drive decision-making in lot of use cases such as fraud detection, marketing, customer experience, etc. There is an increasing need to w …
Lightning Talk: Open Match - Matchmaking Framework

Lightning Talk: Open Match - Matchmaking Framework

December 23, 2019

Open Match is an open source game matchmaking framework that simplifies building a scalable and extensible Matchmaker. Open Match is designed to give the game developer full control over how to genera …
Live Aggregators: A scalable, cost-effective, and reliable way of aggregating billions of messages in real time

Live Aggregators: A scalable, cost-effective, and reliable way of aggregating billions of messages in real time

December 23, 2019

Osman Sarood and Chunky Gupta discuss Mists real-time data pipeline, focusing on Live Aggregators (LA)a highly reliable and scalable in-house real-time aggregation system that can autoscale for sudden changes in load. LA is 80% cheaper than competing streaming solutions due to running over AWS Spot Instances and having 70% CPU utilization.
Serverless workflows for orchestration hybrid cluster-based and serverless processing

Serverless workflows for orchestration hybrid cluster-based and serverless processing

December 21, 2019

Serverless implementation of core processing is quickly becoming a production-ready solution. However, companies with existing processing pipelines may find it hard to go completely serverless. Serverless workflows unite the serverless and cluster worlds, with the benefits of both approaches. Rustem Feyzkhanov demonstrates how serverless workflows change your perception of software architecture.
Cortex 101: Horizontally Scalable Long Term Storage for Prometheus

Cortex 101: Horizontally Scalable Long Term Storage for Prometheus

December 19, 2019

Cortex provides horizontally scalable, highly available, multi-tenant, long term storage for Prometheus metrics, and a horizontally scalable, Prometheus-compatible query API. Cortex allows users to de …