The Patterns of Distributed Logging and Containers [I]

In recent days, logging becomes important more and more. Microservices produce much more various logs than past, and also require to see many logs to trace what users do. Containers are very useful fo …

In recent days, logging becomes important more and more. Microservices produce much more various logs than past, and also require to see many logs to trace what users do. Containers are very useful for microservice architecture, but containers cannot have persistent storage in many cases. It makes “tracable” logging hard. This talk will explain some patterns of logging architecture on container based computing, show an example using Fluentd and discuss about best practice to scale it from startup size to huge platform. These discussions include how to ship logs from applications in containers, how to ship logs from middleware (e.g., web servers) in containers, how to gather these logs from many servers which runs containers and how to store whole logs into many/various storages.