RoCE
Use the UI or CLI to monitor RDMA over Converged Ethernet (RoCE) in your network.
RoCE Commands
The following commands display your network’s RoCE configuration, RoCE counters and counter pools, and RoCE-related events. See the command line reference for additional options, definitions, and examples.
netq show roce-config
netq show roce-counters
netq show roce-counters pool
netq show events message_type tca_roce
netq show events message_type roceconfig
Priority code point (PCP) monitoring requires a switch running NetQ Agent 4.5 or later.
The netq check roce command checks for consistent RoCE and QoS configurations across all nodes in your network fabric.
netq check roce
View RoCE Counters Networkwide in the UI
Select the Menu.
Under the Network heading, select RoCE counters. Use the tabs to view receive (Rx), transmit (Tx), and pool counters networkwide.
View RoCE Counters for a Given Switch
You can view the following RoCE counters for a given switch:
- Receive and transmit counters
- General, CNP, and RoCE-specific counters
- Counter pools
- Port-specific counters
To view RoCE counters on a switch, navigate to the header and select Devices, then click Open a device card. Select the large card, then click the RoCE icon at the top of the card to view RoCE counters and their associated ports:
Expand the card to the largest size, then select RoCE counters from the side menu. Use the controls above the table to view, filter, or export counter statistics by Rx, Tx, or Pool:
Disable RoCE Monitoring
To disable RoCE monitoring:
Edit
/etc/netq/commands/cl4-netq-commands.yml
and comment out the following lines:cumulus@netq-ts:~$ sudo nano /etc/netq/commands/cl4-netq-commands.yml #- period: "60" # key: "roce" # isactive: true # command: "/usr/lib/cumulus/mlxcmd --json roce counters" # parser: "local"
Delete the
/var/run/netq/netq_commands.yml
file:cumulus@netq-ts:~$ sudo rm /var/run/netq/netq_commands.yml
Restart the NetQ Agent:
cumulus@netq-ts:~$ netq config agent restart