image image image image image

On This Page

This section includes history of changes and new feature of 3 major releases back. For older releases history, please refer to the relevant firmware versions.

Feature/ChangeDescription

16.32.1010

GMP ClassesAdded support for blocking unwanted GMP classes by dedicated MADs.
QP Resources

Added a new NvConfig parameter LOG_MAX_QUEUE to set the maximum number of work queue resources (QP, RQ, SQ...) that can be created per function.

The default value is 2^17.

Congestion Control Key

Added a Congestion Control Key to all Congestion Control MADs to authenticate that they are originated from a trusted source.

SMP Firewall

Added an SMP firewall to block the option of sending SMPs (MADS sent on QP0 from the Subnet Manager) from unauthorized hosts to prevent fake SMPs from being recognized as the SM.

Vendor Specific MADs: Class 0x9Vendor Specific MADs Class 0x9 is no longer supported by the firmware. If case the firmware detects such  MAD, the firmware will return a "NOT SUPPORTED" error to the user.
TLS/XTS/Signature PaddingBlocked the VF's ability to use both padding and signature in order to prevent the NIC from hanging. 
Asserts' Severity Level

Added 3 new assert filters (Health buffer, NVlog, FW trace). The assert will be exposed now if its severity level is equal to or above the new filter.

The filters are configurable by the ini file. The "Health buffer" filter is also configurable by new access register.

VUID VPD Virtio

An emulated PCI device can be hot plugged/unplugged by the DPU software stack. However, the life cycle and the state of the bare metal host system where an emulated PCI device is plugged in, is not in control of the DPU software stack.

PCI BDF may not be available in corner cases, hence, an emulation PCI device handler (VUID) is required which is predictable and stable (across emulation controller reset/restart, across DPU warm reboot). The VUID will show in PCI PF device VPD as [VU] section.

Rate Limit per VM instead of VM-TCEnabled Rate Limit per VM instead of VM-TC. This capability is implemented by adding support to a new Scheduling element type: rate limit elements that will connect to the rate_limit and will share its  rate limit.
Dynamically Connected Transport (DCT) with Adaptive Routing (AR)Performance improvements in the DCT with AR flow by exposing a hint to the software in DCI software context that indicates that RDMA WRITE on this DCI is not supported.
Dynamic Timeout MechanismAdded support for dynamic timeout mechanism when in InfiniBand mode.
QSHR Access RegisterAdded support for QSHR access register to enable Set and Query rate limit per-host per-port.
New Software Steering ICM Resource for VXLAN EncapsulationThe firmware now exposes a new Software Steering ICM resource for VXLAN encap expand in order for the SW Steering to manage this resource directly.
Asymmetrical VFs per PF

Added support for asymmetrical VFs per PF. 

To enable it:
PF_NUM_OF_VF_VALID must be true, and PF_NUM_OF_VF to a none zero value.

mlxlink Support to read/write Access Registers by LIDAdded 2 new MAD access registers to enable mlxlink to read/write access registers by LID (to the whole subnet).
VXLAN Encapsulation ExpansionEnabled the exposure of new ICM resource to the software steering for VXLAN encapsulation expansion.
Bug Fixes

See Bug Fixes section. 

16.31.1014

NIC SchedulingNIC scheduling feature support has been disabled for non-privileged functions.
Using NC-SI Commands for Debugging PCI Link FailuresImplemented a new NC-SI command get_debug_info to get mstdump via the NC-SI protocol to debug a device if the PCI link fails for any given reason.
Enable/Disable RDMA via the UEFI HII System Settings

Added support for Enabling/Disabling NIC and RDMA (port/partition) via the UEFI HII system settings.

Note: Values set in this option only take effect when is Ethernet mode.

Increased the Maximum Number of MSIX per VFIncreased the maximum number of MSIX per VF to 127.
Note that increasing the number of MSIX per VF (NUM_VF_MSIX) affects the configured number of VFs (NUM_OF_VFS). The firmware may reduce the configured number of MSIX per VF and/or the number of VFs with respect to maximum number of MSIX vectors supported by the device (MAX_TOTAL_MSIX).
Asymmetrical MSIX Configuration

This feature allows the device to be configured with a different number of MSIX vectors per physical PCI functions.

To use this feature, please follow these steps:

  1. Clear NUM_PF_MSIX_VALID to disable global symmetrical MSIX configuration.
  2. Set PF_NUM_PF_MSIX_VALID to enable asymmetrical per Physical Function MSIX configuration.
  3. Configure PF_NUM_PF_MSIX per physical PCI function.

Notes:

  • When using this configuration, NUM_PF_MSIX (the symmetrical MSIX configuration field) will be ignored by the firmware although it will be present in the mlxconfig query.
  • The asymmetrical MSIX configuration and the legacy symmetrical MSIX configuration are mutually exclusive. When both are enabled, the firmware will work according to the symmetrical MSIX configuration.
  • Step #3 should be done on each of the physical PCI functions, otherwise, the device will use default configurations.
RDMA, NC-SIAdded support for RDMA partitioning and RDMA counters in IB mode.
Adaptive Routing (AR): multi_path, data_in_orderAdded a new bit ("data_in_order") to query the QP and allow a process/library to detect when the AR is enabled.
flex_parser for GENEVE Hardware Offload and ICMPAdded a new flex parser to support GENEVE hardware offload and ICMP.
Non-Page-Supplier-FLR

When the non-page-supplier-FLR funcion is initiated, the firmware triggers a page event to the page supplier to indicate that all pages should be returned for the FLR function.

Pages are returned by the driver to the kernel without issuing the MANAGE_PAGES commands to the firmare.

User Memory (UMEM)Enabled UID 0 to create resources with UMEM. 
Native IB PacketsAdded support for receiving and sending native IB packets from/to the software (including all headers) via raw IBL2 QPs.
InfiniBand Packet SteeringAdded support for RX RDMA NIC flow table on an IB port. Now the software can steer native IB packets to raw IB receive queues according to the DLID and the DQPN.
Bug Fixes

See Bug Fixes section. 

16.30.1004

RoCE, Lossy, slow_restart_idleRemoved triggering unexpected internal CNPs for RoCE Lossy slow_restart_idle feature.
Performance: SteeringAdded support for a new NV config mode “icm_cache_mode_large_scale_steering” that enables less cache misses and improves performance for cases when working with many steering rules.
This capability is enabled using the mlxconfig parameter "ICM_CACHE_MODE".
VF/VF-group rate-limitingThis new capability enables VF/VF-group rate-limiting while per-host rate-limiter is also applied.
NvConfig: Sub-FunctionsThis new capability enables asymmetric Sub-Function configuration. It expands the asymmetric Sub-Function configuration to support asymmetric configurations between all PFs, and provides Sub-Function scalability and asymmetric NV configurations.
Bug Fixes

See Bug Fixes section. 

16.29.2002

Reserved QPN

[Beta] This capability allows the software to reserve a QPN that can be used to establish connection performed over RDMA_CM, and provide the software a unique QP number.

Since RDMA_CM does not support DC, by using CREATE_QPN_RESERVED_OBJECT the software can reserve a QPN value from the firmware's managed QP number namespace range. This allows multiple software processes to hold a unique QPN value instead of using UD-QPs.

Bug Fixes

See Bug Fixes section. 

16.29.1016

Multi-Application QoS per QPAdded the option to allow applications to build their own QoS tree over the NIC hierarchy by connecting QPs to responder/requestor Queue Groups.
InfiniBand Support in RDEAdded "InfiniBand" properties set to the Network Device Function Redfish object.
HW Support for Flow MeteringAdded HW support for Flow Metering to utilize Advanced Steering Operation (ASO). HW Flow Meter allows higher scale, more accuracy, and better performance compare to the FW Flow Metering.
HW Offloads Enablement on VFAdded trust level for VFs. Once the VF is trusted, it will get a set of trusted capabilities.
Mini CQE Formats

Added 2 new Mini CQE formats:

  • Responder Mini CQE With Flow Tag Layout
  • Responder Mini CQE With l3_l4_info Layout
Enabling Adaptive-Routing (AR) for the Right SL via UCXUCX can now enable AR by exposing Out-Of-Ordering bitmask per SL with "ooo_per_sl" field in the HCA_VPORT context. It can be also queried by running the QUERY_HCA_VPORT_CONTEXT command.
Connection HashingAdded support for steering DP hash flow groups.
Ethernet wqe_too_small ModeAdded a new counter per vPort that counts the number of packets that reached the Ethernet RQ but cannot fit into the WQE due to their large size. Additionally, we added the option to control if such packet will cause “CQE with Error” or “CQE_MOCK”.
PCIePCIe Rx modifications to prevent the adapter cards from disappearing from the system.
Access Registriesignore_flow_level is now enabled by the TRUST LEVEL access registry. 
CountersAdded support for the cq_overrun counter. The counter represents the number of times CQs enter an error state due to overflow that occur when the device tries to post a CQE into a full CQ buffer.
Pause Frames from VFs[Beta] Enabled the capability to allow Virtual Functions to send Pause Frames packets.
Auto-SensingEnabled 10/25GbE auto-sensing with 3rd party when using 10/25GbE optical cables.
Steering Dump

Hardware steering dump output used for debugging and troubleshooting.

Please see Known Issue 2213356 for its limitations.

16.28.2006

Sub Function (SF) BAR Size

Increased the minimum Sub Function (SF) BAR size from 128KB to 256KB. Due to the larger SF BAR size, for the same PF BAR2 size, which can be queried/modified by LOG_PF_BAR2_SIZE NV config, the firmware will support half of the SFs.

To maintain the same amount of supported SFs, software needs to increase the LOG_PF_BAR2_SIZE NV config value by 1.

VXLAN Extension HeaderThis feature enables the user to define their own VXLAN extensions for the VXLAN header. The last byte of the VXLAN header is used as a length value for the private extension headers that comes after the VXLAN headers. This VXLAN extension header is supported when the "flex_parser_profile_6_supported" parameter is configured. 
GPUDirect in Virtualized EnvironmentEnabled a direct access to ATS from the NIC to GPU buffers using PCIe peer-to-peer transactions. To enable this capability, the “p2p_ordering_mode” parameter was added to the NV_PCI_CONF configuration.
Note: When SECURE_ALL or SECURE_TRUST is configured, ATS and RO must be set identically. When SECURE_NONE is configured, ATS and RO may be set independently as the current firmware behavior allows.
Non-Volatile Configurations

Added a new Non-Volatile Configuration parameter to control VL15 buffer size (VL15_BUFFER_SIZE).

Note: VL15 buffer size enlargement will decrease all other VLs buffers size.

NC-SIAdded a new NC-SI command (get_device_id) to report a unique device identifier.
NC-SIAdded new NC-SI commands (get_lldp_nb, set_lldp_nb) to query the current status of LLDP and to enable/disable it.
ROCE ACCL

Split the SlowRestart ROCE_ACCL into the following:

  • slow-restart – used to reduce rate on retransmission events
  • slow-restart-after-idle – used to reduce rate before first transmission after >1s without transmitting
ROCE ACCL

Enabled TX PSN window size configuration using LOG_TX_PSN_WINDOW NVconfig parameter.

Note: Due to hardware limitations, max log_tx_psn_win value can be set 9.

Bug FixesSee Bug Fixes.

16.28.1002

Flow Sampling and MirroringAdded support for flow sampling and mirroring with an associated capable software.
Hardware Tag MatchingIncreased the maximum XRQ number to 512.
Non-Volatile Configurations (NVCONFIG)

Added the following new mlxconfig parameters to the Non-Volatile Configurations section.

  • log_max_outstandng_wqe
  • ece_disable_mask
NC-SI 1.2 New Commands

Implemented the following new commands from NS-SI 1.2 specification:

  • Get IB Link Status
  • Get IB Statistics
  • Get PF Assignment
Resourcedump

Added the following segments, as appeared in the PRM, to the Resource Dump:

  • PRM_QUERY_QP
  • PRM_QUERY_CQ
  • PRM_QUERY_MKEY
  • QUERY_VNIC_ENV
Bug FixesSee Bug Fixes.