One RDMA device (HCA) can be shared among multiple Pods running in a Kubernetes worker nodes. User defined networks are created using VXLAN or VETH networking devices. RDMA device (HCA) can be shared among multiple Pods running in a Kubernetes worker nodes.
Kubernetes with Shared HCA
NVIDIA MLNX_OFED Documentation v24.01-0.3.3.1