Sort by:  

Authors: Fernando Barreiro Megino, Lukas Heinrich

tldr - powered by Generative AI

The presentation discusses the use of Kubernetes in high energy physics data analysis, specifically for batch processing and interactive analysis facilities.
  • Kubernetes is used for batch processing in high energy physics data analysis, allowing for scaling up to hundreds of thousands of cores with minimal failure rates.
  • Kubernetes also enables the use of heterogeneous architectures, such as ARM and GPU resources, for data analysis.
  • Interactive analysis facilities using Jupiter and Dask are also implemented using Kubernetes, allowing for dynamic scaling of resources.
  • The presentation includes anecdotes of successful use of Kubernetes in simulating events on ARM resources and scaling up task clusters for faster data analysis.