[TALK]@Telematika

code

Experience Report - Evolving a Continuous Delivery Workflow to Kubernetes using Spinnaker

December 2, 2019

Schibsted started deploying to Kubernetes with Spinnaker about a year ago. In that time, application deployment has evolved from simple point and click pipelines in Spinnaker to being fully defined as …

Kata Containers: Getting Involved with the Kata Community

December 1, 2019

Kata Containers is a new open source project that combines the security of VMs with the speed of containers by providing extremely lightweight VMs for each container, while meeting OCI standards. This …

Performance and Scale @ Istio Service Mesh

December 1, 2019

In this session, members from Istio Performance and Scalability working group will talk about the work they have done over the past few months on performance and scalability using a four pronged appro …

Achieving GDPR compliance and data privacy using blockchain technology

November 30, 2019

Ajay Mothukuri and Vijay Srinivas Agneeswaran explain how to use open source blockchain technologies such as Hyperledger to implement the European Union's General Data Protection Regulation (GDPR) regulation.

Apache Spark programming

November 29, 2019

Brooke Wenig walks you through the core APIs for using Spark, fundamental mechanisms and basic internals of the framework, SQL and other high-level data access tools, and Sparks streaming capabilities and machine learning APIs.

Building a Go AI with Kubernetes and TensorFlow

November 29, 2019

Reinforcement learning approaches can be massively parallelized, so Kubernetes seems like a natural fit, as Kubernetes is all about reducing the overhead for managing applications. However, it can be …

Writing Kube Controllers for Everyone

November 29, 2019

With the introduction of Custom Resource Definition, as well as external API servers everyone is now able to create its own resources and store them inside kubernetes cluster. But that is only half of …

Code Property Graph: A modern, queryable data storage for source code

November 28, 2019

Vlad Ionescu and Fabian Yamaguchi outline Code Property Graph (CPG), a unique approach that allows the functional elements of code to be represented in an interconnected graph of data and control flows, which enables semantic information about code to be stored scalably on distributed graph databases over the web while allowing them to be rapidly accessed.

Cuttlefish: Lightweight primitives for online tuning

November 28, 2019

Tomer Kaftan offers an overview of Cuttlefish, a lightweight framework prototyped in Apache Spark that helps developers adaptively improve the performance of their data processing applications by inserting a few library calls into their code. These calls construct tuning primitives that use reinforcement learning to adaptively modify execution as they observe application performance over time.

Challenges to Writing Cloud Native Applications

November 27, 2019

Cloud native means designing software explicitly for the cloud, not trying to deploy to the cloud in retrospect - shoving a single replica of a monolith into Kubernetes wont cut it. Developing for …

Data science in the cloud

November 27, 2019

In this talk Alex will discuss lessons learned from AWS SageMaker, an integrated framework for handling all stages of analysis. AWS uses open source components such as Jupyter, Docker containers, Python and well established deep learning frameworks such as Apache MxNet and TensorFlow for an easy to learn workflow.

Defining responsible data practices: A community-driven approach

November 27, 2019

Natalie Evans Harris explores the Community Principles on Ethical Data Practices (CPEDP), a community-driven code of ethics for data collection, sharing, and utilization that provides people in the data science community a standard set of easily digestible, recognizable principles for guiding their behaviors.

Good Enough for the Finance Industry: Achieving High Security at Scale with Microservices in Kubernetes

November 27, 2019

Security is a challenge for most companies. Especially those in periods of rapid growth. It is often taken for granted as we trust the frameworks we use to implement the necessary security protocols f …

Pod Anomaly Detection and Eviction using Prometheus Metrics

November 27, 2019

Dealing with system stability in a distributed and changing environment is a challenge: a single failing pod can affect the majority of your system responses. From Kubernetes probes to Istio circuit b …

Enough data engineering for a data scientist; or, How I learned to stop worrying and love the data scientists

November 26, 2019

Stephen O'Sullivan takes you along the data science journey, from onboarding data (using a number of data/object stores) to understanding and choosing the right data format for the data assets to using query engines (and basic query tuning). You'll learn some new skills to help you be more productive and reduce contention with the data engineering team.

How We Used Jaeger and Prometheus to Deliver Lightning-Fast User Queries

November 26, 2019

This talk comes from practical experience of running a cloud-based SAAS under Kubernetes for the last two years. Prometheus is good for the big picture view of how things are running, while Jaeger act …

Building a Kubernetes Scheduler using Custom Metrics

November 24, 2019

The default Kubernetes scheduler does a fantastic job for typical workloads, but when you have specific requirements (like higher level application metrics) you might need other scheduling methods. …

Deploying SQL Stream Processing in Kubernetes with Ease

November 22, 2019

Real-time processing allows you to act faster and SQL allows you to construct flows quicker and reuse existing skills. Apache Kafka is a key component but how do you peek into the data, the topologies …

Playing well together: Big data beyond the JVM with Spark and friends

November 22, 2019

Holden Karau and Rachel Warren explore the state of the current big data ecosystem and explain how to best work with it in non-JVM languages. While much of the focus will be on Python + Spark, the talk will also include interesting anecdotes about how these lessons apply to other systems (including Kafka).

sparklyr, implyr, and more: dplyr interfaces to large-scale data

November 20, 2019

Streaming applications as microservices using Kafka, Akka Streams, and Kafka Streams

November 20, 2019

Join Dean Wampler and Boris Lublinsky to learn how to build two microservice streaming applications based on Kafka using Akka Streams and Kafka Streams for data processing. You'll explore the strengths and weaknesses of each tool for particular design needs and contrast them with Spark Streaming and Flink, so you'll know when to choose them instead.

Securing Serverless Functions via Kubernetes Objects

November 19, 2019

Serverless is fast becoming a new application architecture paradigm. As glue code that links cloud services together it is tempting to forget about the security of functions being deployed. In this ta …

SIG API Machinery Deep Dive

November 19, 2019

SIG API Machinery is responsible for all generic API topics in Kubernetes, i.e. for the generic API server implementation, API CRUD semantics, discovery,the admission control mechanism, conversion, d …

Vectorized query processing using Apache Arrow

November 19, 2019

Query processing technology has rapidly evolved since the iconic C-Store paper was published in 2005, with a focus on designing query processing algorithms and data structures that efficiently utilize CPU and leverage the changing trends in hardware to deliver optimal performance. Siddharth Teotia outlines the different types of vectorized query processing in Dremio using Apache Arrow.

Working with the data of sports

November 18, 2019

Sports analytics today is more than a matter of analyzing box scores and play-by-play statistics. Faced with detailed on-field or on-court data from every game, sports teams face challenges in data management, data engineering, and analytics. Thomas Miller details the challenges faced by a Major League Baseball team as it sought competitive advantage through data science and deep learning.

Continuous delivery in an ephemeral world

November 17, 2019

With systems like Travis CI, Circle CI, and CodeBuild, we're never more than a few lines of YAML away from a complete continuous delivery pipeline. However, ephemeral build systems constantly recreate the world from scratch, increasing build time and lengthening the CD feedback loop. John Chapin addresses those challenges and shares a reference pipeline using AWS CodePipeline and CodeBuild.

Source2Image Deep Dive

November 17, 2019

This session is dedicated to an in-depth understanding of building images on or for Kubernetes. We will present some best practices, give some short demos and discuss some improvements that can be mad …

Incremental architecture

November 15, 2019

If you still use large up-front design phases, you'll likely encounter problems with your design as you implement. The solution is to build around a domain-focused metaphor that allows for incremental changes while maintaining coherence throughout. Allen Holub demonstrates how to develop an effective and coherent architecture incrementally as the code evolves.