In order to use RDMA in Kubernetes environment with SR-IOV networking mode, two main components are required:
RDMA device plugin - this plugin allows for exposing RDMA devices in a Pod
SR-IOV CNI plugin - this plugin provisions VF net device in a Pod
When used in SR-IOV mode, this plugin enables SR-IOV and performs necessary configuration including setting GUID, MAC, privilege mode, and Trust mode.
The plugin also allocates the VF devices when Pods are scheduled and requested by Kubernetes framework.
For instructions on how to use Kubernetes with SR-IOV, refer to the following Community posts: