Storage and Networking: Rook on Multus


Authors:   Rohan Gupta, Sebastien Han


The presentation discusses the use of Multus in Rook-Ceph to better utilize host network interfaces for Ceph Public and Cluster Networks, and the benefits of having dedicated networks for storage.
  • Kubernetes presents challenges for storage due to reliance on external storage and lack of portability
  • Rook-Ceph is an open source storage operator for Kubernetes that provides persistent storage from within the cluster
  • Ceph is a distributed storage software solution that is scalable and provides multiple storage interfaces
  • Multus allows for the use of multiple network interfaces on pods, and IP address management for a smoother deployment experience
  • Dedicated networks for storage boost performance
  • The presentation includes a demo of a running cluster utilizing Multus networks and a comparison of performance with and without Multus
The presentation highlights the challenges of relying on external storage and the lack of portability when deploying on different platforms. Rook-Ceph provides a solution by allowing for persistent storage from within the Kubernetes cluster, providing a homogenous experience regardless of the platform. Multus is used to better utilize host network interfaces for Ceph Public and Cluster Networks, and dedicated networks for storage boost performance. The demo illustrates the benefits of using Multus networks and the performance improvement it provides.


Networking plays an important role in the world of baremetal cloud storage. I/O on devices are dependent on network latency. Rook-Ceph now makes use of multus to better utilize host network interfaces for Ceph Public and Cluster Networks. Having dedicated networks for storage boosts performance. This talk will introduce Ceph public and cluster networks and their use cases, the requirement of dedicated networks in baremetal environment, HostNetworking vs Multus, defining network-attachment-definitions, and how Rook-Ceph utilizes it. It will also include a demo showing an already running cluster utilizing multus networks and we will compare the performance with and without multus. By the end of the talk, you'll know the perks of using private and cluster networks, when to use them, and will be able to create a basic networking setup for Rook-Ceph.