Envoy Internals Deep Dive

Envoy (https://www.envoyproxy.io/) is a high performance L4/L7 network proxy with a pluggable filter chain model; this allows Envoy to be used for a variety of different scenarios, including HTTP/2, g …

Envoy (https://www.envoyproxy.io/) is a high performance L4/L7 network proxy with a pluggable filter chain model; this allows Envoy to be used for a variety of different scenarios, including HTTP/2, gRPC, MongoDB, and Redis. Envoy provides advanced load balancing support, including eventually consistent service discovery, circuit breakers, retries, rate limiting, and zone-aware load balancing. Envoy also has best-in-class observability, using statistics, logging, and distributed tracing. Since becoming OSS in 2016, Envoy has gained substantial traction in both “service mesh” and edge (API gateway) deployments. In this talk, Matt Klein will dive deep into Envoy internals from a systems perspective, covering threading model, stats, hot restart, the xDS APIs, and other core concepts. This is an advanced talk and prior knowledge of what Envoy is at a high level is assumed.