logo

Fluentd and Fluent Bit

2021-10-14

Authors:   Eduardo Silva


Summary

Fluent Bit is an engine that processes and sends data out to a preferred destination, designed with performance and optimization in mind for the cloud native ecosystem.
  • Fluent Bit is part of the Fluent ecosystem and is used widely by companies such as AWS, Google Cloud, and Microsoft Azure
  • Fluent Bit was designed with performance and optimization in mind for the cloud native ecosystem
  • Buffer management is important for optimizing how data is stored between memory and file system
  • Fluent Bit uses binary formats instead of JSON for better performance
  • Fluent Bit is stable and reliable, with an average of two million deployments per day
Fluent Bit is used widely in the cloud native ecosystem, with an average of two million deployments per day. It was designed with performance and optimization in mind, and buffer management is important for optimizing how data is stored between memory and file system. Fluent Bit uses binary formats instead of JSON for better performance. Companies such as AWS, Google Cloud, and Microsoft Azure use Fluent Bit, and it is stable and reliable.

Abstract

Observability pipelines are a critical component on every production environment. Fluentd and Fluent Bit are well known and used for Log collection and processing. But for years our community of users have asked for a unified experience with Metrics collection. In this presentation, you will learn about our new Metrics collection and processing with Fluentd and Fluent Bit. You will learn the best practices for monitoring and how to leverage your current Prometheus services and infrastructure by using all the component together without any observability disruption.

Materials: