code

Apache Spark ML and MLlib tuning and optimization: A case study on boosting the performance of ALS by 60x

Apache Spark ML and MLlib tuning and optimization: A case study on boosting the performance of ALS by 60x

January 2, 2020

Apache Spark ML and MLlib are hugely popular in the big data ecosystem, and Intel has been deeply involved in Spark from a very early stage. Peng Meng outlines the methodology behind Intel's work on Spark ML and MLlib optimization and shares a case study on boosting the performance of Spark MLlib ALS by 60x in JD.coms production environment.
How Kubernetes was the Secret Sauce in Our Globally Distributed Teams Transition to Microservices

How Kubernetes was the Secret Sauce in Our Globally Distributed Teams Transition to Microservices

January 2, 2020

It can be hard to fundamentally change how applications are built at a fast moving SaaS startup. Getting buy in, training and changing engineers daily workflows are some of the many challenges. Worki …
ITNW (If This Now What) - Orchestrating an Enterprise

ITNW (If This Now What) - Orchestrating an Enterprise

January 2, 2020

With growing demand for containers in the enterprise, Pearson chose to lay its foundation with Kubernetes. With 400+ development teams across varying business units, the platform is absolutely critica …
Upcoming Changes to BGP Flow Specification

Upcoming Changes to BGP Flow Specification

January 1, 2020

Flow Specification insert policies that control and channel traffic flows in networks to orchestrate traffic in SDN, direct traffic to pathways for specific proces …
Getting started with TensorFlow

Getting started with TensorFlow

December 31, 2019

Yufeng Guo walks you through training and deploying a machine learning system using TensorFlow, a popular open source library. Yufeng takes you from a conceptual overview all the way to building complex classifiers and explains how you can apply deep learning to complex problems in science and industry.
Interactive visualization for data science

Interactive visualization for data science

December 31, 2019

One of the challenges in traditional data visualization is that they are static and have bounds on limited physical/pixel space. Interactive visualizations allows us to move beyond this limitation by adding layers of interactions. Bargava Subramanian and Amit Kapoor teach the art and science of creating interactive data visualizations.
Delivering Services at DigitalOcean

Delivering Services at DigitalOcean

December 30, 2019

Though kubernetes itself provides a rich collection of resources to deploy services it also comes with a bundle of complexity. This is where DOCC (DigitalOcean Control Center) comes in. This talk will …
Hackathon

Hackathon

December 30, 2019

Join us for the NANOG 67 Hackathon – a one-day event Sunday, June 12, 2016, at the Fairmont Chicago Millennium Park. The NANOG 67 Hackathon will bring network ope …
Keynote: OpenTracing and Containers: Depth, Breadth, and the Future of Tracing

Keynote: OpenTracing and Containers: Depth, Breadth, and the Future of Tracing

December 30, 2019

Those building microservices at scale understand the role and importance of distributed tracing: its the most direct way to understand how and why a system is misbehaving. But distributed tracing has …
Life of a Kubernetes API Request

Life of a Kubernetes API Request

December 30, 2019

We'll follow an API request through the Kubernetes API stack, starting from kubectl and ending with the storage layer (etcd). This is targeted at people who want to develop Kubernetes itself. We will …
Test your way to a better deployment!

Test your way to a better deployment!

December 30, 2019

Ever wondered why your network deployment timelines always get pushed out? Or why your network config validation takes weeks, sometimes months? Could you enable be …
Third Party Dynamic Volume Provisioners

Third Party Dynamic Volume Provisioners

December 30, 2019

Kubernetes 1.4 introduces an API for dynamic provisioning of persistent volumes by third party provisioners. Any storage vendor, big or small, open or proprietary, can write a standalone plugin that c …
Chronix as Long Term Storage for Prometheus

Chronix as Long Term Storage for Prometheus

December 29, 2019

Prometheus is great when it comes to monitoring and alerting. But the long term storage opportunities are comparatively weak compared to related time series databases (missing data distribution, shard …
Next-Generation Microservices on Kubernetes. Live from Bloomberg - Paul McLaughlin &

Next-Generation Microservices on Kubernetes. Live from Bloomberg - Paul McLaughlin &

December 29, 2019

Enterprise deployments are complicated. When managing proprietary technologies, sensitive client data and complex rules for access rights you inevitably arrive at a situation where your PROD environme …
Off the Beaten Path: An Explorers Guide to Kubernetes

Off the Beaten Path: An Explorers Guide to Kubernetes

December 29, 2019

In the past year, Kubernetes proved itself as a powerful tool for creating and managing service based architectures. However, as with anything new, it is easy to find yourself lost when the complexity …
State of the GPU(nion)

State of the GPU(nion)

December 29, 2019

As Kubernetes becomes more popular, the number of use cases for it grow as well, bringing with them more specialized requirements. Scheduling and launch of containers that interact with GPUs is one of …
Clouds ahead: Work with @WalmartLabs's hybrid, multicloud environment

Clouds ahead: Work with @WalmartLabs's hybrid, multicloud environment

December 27, 2019

Faraz Mohammed discusses lessons learned working with @WalmartLabs's internal open source software project OneOps.
Containerization at Pinterest

Containerization at Pinterest

December 27, 2019

Baogang Song shares Pinterest's unique journey adopting Docker technology. Baogang highlights how Pinterest used Teletraan, its code deploy system, to safely deploy dockers in production with little effort and limited Docker operational experience.
Designed for deployment

Designed for deployment

December 27, 2019

The process of analysis and reasoning about a running system or designing for deployment concerns is very different from the process of synthesis and composition involved in writing application software. Badrinath Janakiraman explores patterns and lessons learned while deploying and maintaining distributed platform Snap CI.
Incremental threat modeling: Never try to boil an ocean

Incremental threat modeling: Never try to boil an ocean

December 26, 2019

Threat modeling is one of the best techniques for achieving secure architectures. However, introducing it on existing complex projects requires time that architects and developers may not have. Irene Michlin introduces a technique for performing threat modeling in ongoing projects without a prohibitive initial time investment.
King Tut architecture: Pyramids, patterns, and tests

King Tut architecture: Pyramids, patterns, and tests

December 26, 2019

What if we considered Mike Cohn's Testing Pyramid a strong statement about application architecture, not a test ratio edict? Could we explicitly design with testability in mind? Should we? What are the real benefits of popular approaches from the past decade, such as TDD, IoC, AOP, and MVx? Gary Pedretti explains how to bring all of these approaches together in a stable, rock-solid whole.
Beyond matching: Applying data science techniques to IOC-based detection

Beyond matching: Applying data science techniques to IOC-based detection

December 25, 2019

Alex Pinto demonstrates how to apply descriptive statistics, graph theory, and nonlinear scoring techniques on the relationships of known network IOCs to log data and how to use those techniques to empower IR teams to encode analyst intuition into repeatable data techniques that can be used to simplify the triage stage and get actionable information with minimal human interaction.
NetOps Coding 101 - Python Intro and Regular Expression Deep Dive

NetOps Coding 101 - Python Intro and Regular Expression Deep Dive

December 25, 2019

(This is a repeat of the tutorial that was presented at NANOG 64 in San Francisco) Do you find yourself wanting to write a robot but not quite sure where to start …
NetOps Coding 101 - Python Intro and Regular Expression Deep Dive (Part 2 of 2)

NetOps Coding 101 - Python Intro and Regular Expression Deep Dive (Part 2 of 2)

December 25, 2019

(Continuation of the first session of this introductory Tutorial.) Do you find yourself wanting to write a robot but not quite sure where to start? Ever find your …
Launching products at massive scale: The DevOps way

Launching products at massive scale: The DevOps way

December 22, 2019

Everything changes at scale. Launching products at a scale of 1+ billion users requires a massive cross-team, cross-functional, coordinated effort, and business, engineering, and cultural challenges must be overcome. Kishore Jalleda and Gopal Mor explain how they have applied DevOps best practices at scale to successfully launch several high-profile products at Yahoo.
Need for speed: Accelerate automation tests from three hours to three minutes

Need for speed: Accelerate automation tests from three hours to three minutes

December 22, 2019

The elephant in the room that every developer ignores is that all automated tests (except unit) are too slow for todays fast-paced, first-to-market environment. With slow automated tests, youre just shipping problems faster to production. Emanuil Slavov explains how the team at Komfo made automated tests run 60x faster using containers, hermetic servers, and improved architecture.
Ops-friendly microservices: Front to back

Ops-friendly microservices: Front to back

December 21, 2019

There's more to microservices than just being small. Modern service-oriented architectures typically reside in more volatile environments, and the lifespan of a single service instance is much shorter than it used to be. Rick Fast explores how to design services and their infrastructure to allow for dynamic placement, resiliency, monitoring, and discovery.
Data flow architecture with Redux and Angular 2

Data flow architecture with Redux and Angular 2

December 18, 2019

This workshop is all about modern SPA architecture, focused on popular architectural design pattern Redux. Redux introduces a unidirectional data-flow and a predictable state container that scales. Through a series of live code examples, Nir Kaufman walks you through a complete flow of a typical application, using Angular2 as the presentation layer.