SR-IOV InfiniBand

Use Case

Virtualized InfiniBand with hardware acceleration. Each pod receives a dedicated VF with isolated IB partitions and direct RDMA access. Common for large-scale HPC clusters and AI/ML training on InfiniBand fabrics.

Prerequisites

Network Operator Helm chart installed (see Installation).
l8k binary on your PATH.
Mellanox NICs in InfiniBand mode on each node.

Discover

Copy
Copied!

            
            l8k discover --kubeconfig ~/.kube/config \
    --save-cluster-config ./cluster-config.yaml

Generate

Copy
Copied!

            
            l8k generate --user-config ./cluster-config.yaml \
    --fabric infiniband --deployment-type sriov --multirail \
    --save-deployment-files ./deployments

Deploy

Copy
Copied!

            
            l8k deploy

Verify

Copy
Copied!

            
            kubectl -n nvidia-network-operator get pods
kubectl get sriovnetworknodepolicy
kubectl get sriovibnetwork

On This Page