cluster

Keynote: Manage the App on Kubernetes

Keynote: Manage the App on Kubernetes

December 3, 2019

Kubernetes has yet to close the developer gap from source code to app running in a production Kubernetes cluster. Many build bespoke tools. How can the Kubernetes community come together to build deco …
Modern Big Data Pipelines over Kubernetes [I]

Modern Big Data Pipelines over Kubernetes [I]

December 3, 2019

Big data used to be synonymous with Hadoop, but our ecosystem has evolved over time with new database, streaming and machine learning solutions which dont necessarily benefit from the Hadoop deployme …
Multi-Tenancy Support & Security Modeling with RBAC and Namespaces [I]

Multi-Tenancy Support & Security Modeling with RBAC and Namespaces [I]

December 3, 2019

As container technologies mature, Kubernetes is clearly gaining momentum with developers as a means to deploy their distributed applications. As more applications and clusters are deployed by more dev …
You Have Stateful Apps - What if Kubernetes Would Also Run Your Storage?

You Have Stateful Apps - What if Kubernetes Would Also Run Your Storage?

December 3, 2019

Kubernetes supports Stateful Applications by connecting to your existing storage. But what if you dont have any? Or the storage capabilities differs between your environments? Wouldnt it be nice if …
How to secure Apache Spark?

How to secure Apache Spark?

December 2, 2019

Security has been a large and growing aspect of distributed systems, specifically in the big data ecosystem, but it's an underappreciated topic within the Spark framework itself. Neelesh Srinivas Salian explains how detailed knowledge of setting up security and an awareness of what to be looking out for in terms of problems and issues can help an organization move forward in the right way.
Kafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]

Kafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]

December 2, 2019

In this talk we will demonstrate an approach to management of kafka clusters in kubernetes deployments. We will show how we can provision kafka clusters and configure it using kubernetes concepts and …
Let's Build Kubernetes, With a Spreadsheet and Volunteers!

Let's Build Kubernetes, With a Spreadsheet and Volunteers!

December 2, 2019

An introduction to the core responsibilities of Kubernetes. A visual representation of how Kubernetes works and what each component does. Building from nothing until we have a fully functional Kuberne …
Shipping in Pirate-Infested Waters: Practical Attack and Defense in Kubernetes [A]

Shipping in Pirate-Infested Waters: Practical Attack and Defense in Kubernetes [A]

December 2, 2019

Kubernetes has a growing array of security controls available, but knowing where they all fit in, what the highest priorities are, and how it all helps against real attacks is still far from obvious. …
Zero Configuration Pattern of Kubernetes on Bare Metal [A]

Zero Configuration Pattern of Kubernetes on Bare Metal [A]

December 2, 2019

In recent releases, we've enabled node admission and configuration APIs that eliminate configuration requirements for Kubernetes workers. This allows cluster operators to add and remove nodes from clu …
Cost-effective Compute Clusters with Spot and Pre-emptible Instances [I]

Cost-effective Compute Clusters with Spot and Pre-emptible Instances [I]

December 1, 2019

Kubernetes and Spot/Pre-emptible Instances (SPIs) are arguably a match made in heaven. Traditionally, the uncertainty of SPIs (they can be terminated at any time due to price fluctuations) have made m …
CrashLoopBackoff, Pending, FailedMount and Friends: Debugging Common Kubernetes Cluster and Application Issues [B]

CrashLoopBackoff, Pending, FailedMount and Friends: Debugging Common Kubernetes Cluster and Application Issues [B]

December 1, 2019

Nothing is more frustrating than deploying a shiny new application on Kubernetes and having it fail immediately (usually five minutes before the big demo). Is it a problem with the pod network? Pods P …
Disaster Recovery for your Kubernetes Clusters [I]

Disaster Recovery for your Kubernetes Clusters [I]

December 1, 2019

Its 3am. Your pager is beeping. Your Kubernetes cluster is down. Dont panic - weve got you covered. In this talk, well describe a variety of disaster scenarios you may encounter. Well arm you wit …
Distributed Database DevOps Dilemmas? Kubernetes to the Rescue

Distributed Database DevOps Dilemmas? Kubernetes to the Rescue

December 1, 2019

Distributed databases can make so many things easier for a developer… but not always for DevOps. OK, almost never for DevOps. Kubernetes has come to the rescue with an easy application orchestrati …
Migrating petabyte-scale Hadoop clusters with zero downtime

Migrating petabyte-scale Hadoop clusters with zero downtime

December 1, 2019

Migrating petabyte-scale Hadoop installations to a new cluster with hundreds of machines, several thousands of jobs daily, and countless ecosystem integrations while maintaining a stable production environment is a challenging task. Alon Elishkov discusses the techniques and tools Outbrain has developed to achieve this goal.
Near-real-time ingest with Apache Flume and Apache Kafka at 1 million-events-per-second scale

Near-real-time ingest with Apache Flume and Apache Kafka at 1 million-events-per-second scale

December 1, 2019

Vodafone UKs new SIEM system relies on Apache Flume and Apache Kafka to ingest over 1 million events per second. Tristan Stevens discusses the architecture, deployment, and performance-tuning techniques that enable the system to perform at IoT-scale on modest hardware and at a very low cost.
Planes, Raft, and Pods: A Tour of Distributed Systems Within Kubernetes [B]

Planes, Raft, and Pods: A Tour of Distributed Systems Within Kubernetes [B]

December 1, 2019

Kubernetes does some pretty neat things for you autoscaling your app, rolling deploys, and more! In this talk, well take a look at how Kubernetes leverages distributed systems to make its magic hap …
Democratizing Machine Learning on Kubernetes [I]

Democratizing Machine Learning on Kubernetes [I]

November 30, 2019

One of the largest challenges facing the machine learning community today is understanding how to build a platform to run common open-source machine learning libraries such as Tensorflow. Both Joy and …
Hacking and Hardening Kubernetes Clusters by Example [I]

Hacking and Hardening Kubernetes Clusters by Example [I]

November 30, 2019

While Kubernetes offers new and exciting ways to deploy and scale container-based workloads in production, many organizations may not be aware of the security risks inherent in the out-of-the-box stat …
One Chart to Rule Them All: Continuous Deployment with Helm at Ticketmaster

One Chart to Rule Them All: Continuous Deployment with Helm at Ticketmaster

November 30, 2019

As Kubernetes continues to mature, it's increasingly hard for users to keep track of the latest resource types, much less the best way to employ them. ReplicationControllers and Services were easy eno …
Prometheus Salon

Prometheus Salon

November 30, 2019

Miss the first instance of the The Prometheus Salon or simply can't get enough? Join Prometheus developers for a closer look at how you can use Prometheus to monitor your Kubernetes cluster, and a dis …
Rethinking stream processing with Apache Kafka: Applications versus clusters and streams versus databases

Rethinking stream processing with Apache Kafka: Applications versus clusters and streams versus databases

November 30, 2019

Michael Noll explains how Apache Kafka helps you radically simplify your data processing architectures by building normal applications to serve your real-time processing needs rather than building clusters or similar special-purpose infrastructurewhile still benefiting from properties typically associated exclusively with cluster technologies.
Self-Hosted Kubernetes: How and Why [I]

Self-Hosted Kubernetes: How and Why [I]

November 30, 2019

How Kubernetes is deployed and managed has changed since the first release of the project. From configuration management systems and unit files to deploying Kubernetes using Kubernetes, a lot has chan …
A question of trust: When good containers go bad

A question of trust: When good containers go bad

November 29, 2019

Container deployments are based on trustwe trust our applications, developers, and infrastructure to be secure and confidently deploy microservices. But what happens when trust is broken? Tim Mackey explores the nature of data center threats and shares measures you can take to proactively identify risks.
Cluster-in-a-Box: Deploying Kubernetes on lxd [B]

Cluster-in-a-Box: Deploying Kubernetes on lxd [B]

November 29, 2019

Deploying kubernetes on top of lxd allows you to build and operate one or more clusters within a single machine, virtual or bare metal. Architect your cluster to be used for development, testing, and …
Dont Hassle Me, Im Stateful

Dont Hassle Me, Im Stateful

November 29, 2019

Stateless, cloud-ready applications are the future for many enterprise users, but what do you do about legacy monoliths, and existing vendor applications? New StatefulSet features within Kubernetes al …
Kubernetes Ingress Controller with Apache Traffic Server [I]

Kubernetes Ingress Controller with Apache Traffic Server [I]

November 29, 2019

Today, the Oath Media Brands and Products container platform is serving critical application workloads like Yahoo Sports and Yahoo Finance at a large scale using Kubernetes as the orchestration framew …
Providing Containerized Cinder Services to Baremetal Kubernetes Clusters [I]

Providing Containerized Cinder Services to Baremetal Kubernetes Clusters [I]

November 29, 2019

Kubernetes deployments running on OpenStack clusters require a full OpenStack: Keystone, Nova, and Cinder services. This talk presents a more pervasive and simplified deployment architecture by integ …
Running Mesos Frameworks on Kubernetes with the Open-Source Universal Resource Broker

Running Mesos Frameworks on Kubernetes with the Open-Source Universal Resource Broker

November 29, 2019

While Kubernetes continues to gain in popularity for cloud applications, many organizations run popular frameworks deployed on Mesos. The need to support multiple orchestration frameworks can result i …