Default RoCE Mode Setting

NVIDIA Docs Hub NVIDIA Networking Networking Software Red Hat Enterprise Linux (RHEL) 8.5 Driver Documentation Default RoCE Mode Setting

Mount the configfs file.

Copy
Copied!

            
            # mount -t configfs none /sys/kernel/config

Create a directory for the mlx4/mlx5 device.

Copy
Copied!

            
            # mkdir -p /sys/kernel/config/rdma_cm/mlx4_0/

Validate what is the used RoCE mode in the default_roce_mode configfs file.

Copy
Copied!

            
            # cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode IB/RoCE v1

Change the default RoCE mode:

For RoCE v1: IB/RoCE v1

Copy
Copied!

            
            # echo "IB/RoCE v1" >
/sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode
# cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode IB/RoCE v1

For RoCE v2: RoCE v2

Copy
Copied!

            
            # echo "RoCE v2" >
/sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode
# cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode RoCE v2