framework

Building a data science idea factory: How to prioritize the portfolio of a large, diverse, and opinionated data science team

November 28, 2019

A huge challenge for data science managers is determining priorities for their teams, which often have more good ideas than they have time. Katie Malone and Skipper Seabold share a framework that their large and diverse data science team uses to identify, discuss, select, and manage data science projects for a fast-moving startup.

Cuttlefish: Lightweight primitives for online tuning

November 28, 2019

Tomer Kaftan offers an overview of Cuttlefish, a lightweight framework prototyped in Apache Spark that helps developers adaptively improve the performance of their data processing applications by inserting a few library calls into their code. These calls construct tuning primitives that use reinforcement learning to adaptively modify execution as they observe application performance over time.

Data science in the cloud

November 27, 2019

In this talk Alex will discuss lessons learned from AWS SageMaker, an integrated framework for handling all stages of analysis. AWS uses open source components such as Jupyter, Docker containers, Python and well established deep learning frameworks such as Apache MxNet and TensorFlow for an easy to learn workflow.

Good Enough for the Finance Industry: Achieving High Security at Scale with Microservices in Kubernetes

November 27, 2019

Security is a challenge for most companies. Especially those in periods of rapid growth. It is often taken for granted as we trust the frameworks we use to implement the necessary security protocols f …

Distributed clinical models: Inference without sharing patient data

November 26, 2019

Clinical collaboration benefits from pooling data to train models from large datasets, but it's hampered by concerns about sharing data. Balasubramanian Narasimhan, John-Mark Agosta, and Philip Lavori outline a privacy-preserving alternative that creates statistical models equivalent to one from the entire dataset.

Distributed deep learning with containers on heterogeneous GPU clusters

November 26, 2019

Deep learning model performance relies on underlying data. Dong Meng offers an overview of a converged data platform that serves as a data infrastructure, providing a distributed filesystem, key-value storage and streams, and Kubernetes as orchestration layer to manage containers to train and deploy deep learning models using GPU clusters.

SPIFFE Deep Dive

November 26, 2019

SPIFFE (Secure Production Infrastructure for Everyone) and SPIRE are two of the newest projects to join the CNCF. These projects build on designs first championed at Google, Twitter and elsewhere to p …

How to protect big data in a containerized environment

November 25, 2019

Recent headline-grabbing data breaches demonstrate that protecting data is essential for every enterprise. The best-of-breed approach for big data is HDFS configured with Transparent Data Encryption (TDE). However, TDE can be difficult to configure and manageissues that are only compounded when running on Docker containers. Thomas Phelan explores these challenges and how to overcome them.

Human in the loop: Bayesian rules enabling explainable AI

November 25, 2019

Pramit Choudhary explores the usefulness of a generative approach that applies Bayesian inference to generate human-interpretable decision sets in the form of "if. . .and else" statements. These human interpretable decision lists with high posterior probabilities might be the right way to balance between model interpretability, performance, and computation.

Compliant Data Management and Machine Learning on Kubernetes

November 24, 2019

Data scientists, machine learning engineers, and researchers are under increasing pressure to provide explanations for how they are processing and managing user data. In particular, the EU's GDPR regu …

Improving user-merchant propensity modeling using neural collaborative filtering and wide and deep models on Spark BigDL at scale

November 24, 2019

Sergey Ermolin and Suqiang Song demonstrate how to use Spark BigDL wide and deep and neural collaborative filtering (NCF) algorithms to predict a users probability of shopping at a particular offer merchant during a campaign period. Along the way, they compare the deep learning results with those obtained by MLlibs alternating least squares (ALS) approach.

Cloud Native Networking for Containers in AWS using CNI Plugins

November 23, 2019

The Container networking interface (CNI) project makes it really simple for container orchestrators to configure networking for containers. In this presentation, Anirudh Aithal will provide a detailed …

Entitlements: Understandable Container Security Controls

November 23, 2019

In this talk Justin Cormack introduces a new system of security entitlements for container workloads. These specify the types of access a pod should have in a human readable way. He will also demonstr …

Machine learning with PyTorch

November 23, 2019

PyTorch is a recent deep learning framework from Facebook that is gaining massive momentum in the deep learning community. Its fundamentally flexible design makes building and debugging models straightforward, simple, and fun. Delip Rao and Brian McMahan walk you through PyTorch's capabilities and demonstrate how to use PyTorch to build deep learning models and apply them to real-world problems.

Magellan: Scalable and fast geospatial analytics

November 23, 2019

How do you scale geospatial analytics on big data? And while you're at it, can you make it easy to use while achieving state-of-the-art performance on a single node? Ram Sriharsha offers an overview of Magellana geospatial optimization engine that seamlessly integrates with Sparkand explains how it provides scalability and performance without sacrificing simplicity.

Modern real-time streaming architectures

November 22, 2019

Across diverse segments in industry, there has been a shift in focus from big data to fast data. Karthik Ramasamy, Sanjeev Kulkarni, Arun Kejariwal, and Sijie Guo walk you through state-of-the-art streaming architectures, streaming frameworks, and streaming algorithms, covering the typical challenges in modern real-time big data platforms and offering insights on how to address them.

Istio - The Weather Company's Journey

November 21, 2019

The Weather Company currently runs and maintains a "home grown" caching, routing, and authorization framework that is capable of handling 24 Billion requests per day. It serves more than than 40 diffe …

The Serverless and Event-Driven Future

November 21, 2019

This talk is presented by Austen Collins, the creator of the Serverless Framework. It will cover the latest trends and use-cases of the serverless movement, as well as the effort happening within the …

Controllers: Lambda Functions for Extending your Infrastructure

November 19, 2019

This session demonstrates how to leverage Kubernetes Controllers and Initializers as a framework for building transparent extensions of your Kubernetes cluster. Using a live coding exercise and demo, …

Architecting an advanced analytics platform for machine learning

November 18, 2019

Georgios Gkekas shares ING's advanced analytics journey to promote modern machine and deep learning techniques internally through a central, best-of-breed technical platform tailored for data science activities. The platform offers only the necessary automated tools to replace the tedious, repetitive, and error-prone steps in a typical data science pipeline.

Architectural trade-offs

November 18, 2019

There are inherent trade-offs that must be made in any software architecture. Some architectural trade-offs are obvious, such as performance versus security or availability versus consistency, while others are quite subtle such as resiliency versus affordability. Jeremy Deane explores a number of architectural trade-offs and offers strategies for dealing with them.

Enterprise architecting for digital disruption

November 16, 2019

The catchphrase of the year is digital disruption. It's finally clear that digital complacency is a path to nonexistence even in industries that havent yet felt the direct impact of the digital era. Joel Crabb explains why retail has been completely disrupted and, in the process, is reinventing enterprise architecture for digital relevancy.

Keynote: Blockchain Consensus Framework

November 15, 2019

Blockchain technology has been gaining popularity in the public, in industry, and in academia. However, these systems are currently limited in their ability to support robust, large-scale applications …

Instrumentation, Resource Allocation and Monitoring for Smart Contracts on the Blockchain

November 14, 2019

Smart contract performance and debuggability are very important criteria to consider when building mission critical enterprise and public blockchains. In their talk, Vijayendra Bhamidipati and Michael …

The Industry Convergence of Automotive and Blockchain

November 14, 2019

Automotive and transportation sits at the very core of society. Legacy technology permeates industry business frameworks, along with a human proclivity to simplicity and a reluctance to change. With c …

The architect as strategist

November 13, 2019

Eben Hewitt explains what the worlds top strategy firms can teach us about the intersection of strategic thinking and architecture and outlines a framework, process, and set of tools that will help you create a powerful technology strategy for your organization.

Why Netflix built an evolutionary architecture

November 13, 2019

As Netflix continues its journey beyond 100M members, the company is rearchitecting its critical Playback API service to better serve its business needs for the next three to five years. Suudhan Rangarajan discusses why and how Netflix rebuilt the Playback API service and outlines a rigorous framework that you can use to reason about your microservice architecture.

Case Study: Santiago Stock Exchange Blockchain Lending Repository. How to Get a Blockchain Project in Production

November 11, 2019

At the Santiago Stock Exchange, we underwent a research project to be the first to implement a Blockchain based solution for the equity market in Chile.In this session we will expose how we gestated t …