logo

Peta Scale Telemetry Backend with Opentelemetry

Conference:  CloudOpen 2022

2022-06-21

Authors:   Weain Deng, Kranti Vikram Anugola


Abstract

Telemetry of distributed applications deployed on a cloud has been a topic of importance across the software industry. Off late Opentelemetry has standardized way to collect metrics from distributed systems. Enriching these with standard traces, logs and events using opentelmetry libs & collectors along with open source tracing backend has helped us build telemetry backend that can handle peta scale telemetry data. In this talk we will share our experience in building and handling petascale telemetry data at scale using open source projects. We will also attempt to touch upon 1. Opensource Projects we used to build this system 2. Scale that we are able to handle 3. Cloud Storage Services that we used to build this system 4. Walmart’s OpenTelemetry adoption strategy.

Materials:

Post a comment

Related work

Authors: Pavol Loffay, Jonah Kowall
2023-04-19


Authors: Michelle Nguyen, Hannah Troisi, Clemens Kolbitsch, Vihang Mehta
2023-04-21


Authors: Prithvi Raj, Joe Elliott

Authors: Pavol Loffay, Jonah Kowall
2022-05-18