Keynote: Building Bridges: Cloud Native and High Performance Computing
Conference: KubeCon + CloudNativeCon Europe 2022
2022-05-19
Authors: Ricardo Rocha
Summary
The presentation discusses the challenges of implementing cloud native and high performance computing (HPC) and how recent work is bridging the gap between the two.
- Cloud native and Kubernetes have become popular in modern IT deployments, but challenges remain in areas where HPC can have a larger impact.
- HPC involves aggregating computing power to deliver higher performance for solving large problems in science, engineering, and business.
- HPC deployments require low latency, high throughput, and numeral awareness, which are not common in most deployments.
- Advanced scheduling is also important for HPC deployments with millions of jobs and users with different software needs.
- The speaker shares an anecdote about CERN's experience with transitioning to Kubernetes for their HPC needs.
- High throughput computing is a similar paradigm to HPC, but focuses on the efficient execution of a large number of loosely coupled tasks.
- The speaker highlights the similarities between high throughput computing and cloud native systems.
Abstract
Kubernetes and Cloud Native have taken over the modern IT deployments, but challenges remain in areas where its impact can still be much larger. The world of High Performance Computing (HPC), often air-gapped, tightly secured and with strong requirements regarding resource sharing for compute intensive workloads has yet to see its needs fully accomplished. This session will cover recent work where the last bits of the bridge are being finished.Click here to view captioning/translation in the MeetingPlay platform!
Materials: