Panoptes: A Network Telemetry Ecosystem - Part Duex

At NANOG 70, we presented Panoptes, the unified network telemetry system under development at Yahoo!, Inc. (now Oath, Inc.). Panoptes monitors dozens metrics on do …

At NANOG 70, we presented Panoptes, the unified network telemetry system under development at Yahoo!, Inc. (now Oath, Inc.). Panoptes monitors dozens metrics on dozens of types of devices, over dozens of sites across thousands of devices which contain hundreds of thousands of interfaces - every sixty seconds. One and a half years have passed since then and we now have a bigger, better version which we describe in this presentation. Specifically, we have introduced an enrichment subsystem, in addition to the discovery and polling subsystems, which allows for complex transformations of metrics based on cached metadata, and also allows collection to be completely decoupled from other parts of the system. This enables new collection subsystems like streaming telemetry based on gNMI to be integrated into the system. We have also built a large scale state aware topology mapping solution on top of the enrichment subsystem. Most importantly, we will be announcing Panoptes’ release to open source, and showing how to get started with both deployment and development. We would like to present our vision for collaboration with users, researchers and vendors to integrate diverse technologies into the Panoptes platform.