Default RoCE Mode Setting

Red Hat Enterprise Linux (RHEL) 9.1 Driver Documentation
  1. Mount the configfs file.

    Copy
    Copied!
                

    # mount -t configfs none /sys/kernel/config

  2. Create a directory for the mlx4/mlx5 device.

    Copy
    Copied!
                

    # mkdir -p /sys/kernel/config/rdma_cm/mlx4_0/

  3. Validate what is the used RoCE mode in the default_roce_mode configfs file.

    Copy
    Copied!
                

    # cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode IB/RoCE v1

  4. Change the default RoCE mode:

  • For RoCE v1: IB/RoCE v1

    Copy
    Copied!
                

    # echo "IB/RoCE v1" > /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode # cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode IB/RoCE v1

  • For RoCE v2: RoCE v2

    Copy
    Copied!
                

    # echo "RoCE v2" > /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode # cat /sys/kernel/config/rdma_cm/mlx4_0/ports/1/default_roce_mode RoCE v2

© Copyright 2023, NVIDIA. Last updated on Feb 4, 2024.