NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual
NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual

Specifications

Warning
  1. Install the ConnectX-6 Dx OCP 3.0 card in a PCIe slot that is capable of supplying the power levels mentioned below for the appropriate use case.

  2. ConnectX-6 Dx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA Ethernet product.

  3. In Standby mode only port0 is available.

Warning

Power numbers are provided for passive cables only. For board power numbers while using active cables, please add the outcome of the following formula to the passive cables' power numbers stated below.

Power while using Active Cables = Card Power with Passive Cable + Active Module Power x Number_of_Modules / 0.9 (efficiency factor).

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Dual SFP28 Ethernet (copper and optical)

Retention Mechanism: Thumbscrew (Pull Tab) Bracket

Protocol Support

Ethernet: 25GBASE-R, 20GBASE-KR2, 10GBASE-LR, 10GBASE-ER, 10GBASE-CX4, 10GBASE-KX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Capabilities

MCX623432AE-ADAB: Crypto Enabled, No Secure Boot
MCX623432AN-ADAB: Crypto Disabled, No Secure Boot
MCX623432AC-ADAB: Crypto Enabled, Secure Boot
MCX623432AS-ADAB: Crypto Disabled, Secure Boot

Power and Airflow

Voltage: 3.3VAUX, 12V

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

15.7W

3.8W

Maximum Power

Passive Cables

19.74W

7.95W

Maximum power available through SFP28 port: 1.5W

Airflow

Cable Type

Hot AisleHSK to Port

Cold AislePort to HSK

Passive Cable

Active Mode @55C

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

400LFM

100LFM

TBD

TBD

Active 0.8W NVIDIA Cable

400LFM

100LFM

TBD

TBD

Active 1.5W Cable

500LFM

150LFM

TBD

TBD

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Dual SFP56 Ethernet (copper and optical)

Retention Mechanism:

MCX623432A[N/C]-GDAB: Thumbscrew (Pull Tab) Bracket

MCX623432AS-GDAI: Internal Lock

Protocol Support

Ethernet: 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate

Ethernet

1/10/25/40/50 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Capabilities

MCX623432AC-GDAB: Crypto Enabled, Secure Boot
MCX623432AN-GDAB: Crypto Disabled, No Secure Boot
MCX623432AS-GDAI: Crypto Disabled, Secure Boot

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

16.9W

4.54W

Maximum Power

Passive Cables

21.4W

8.75W

Maximum power available through SFP56 port: 2W

Airflow

Cable Type

Hot AisleHSK to Port

Cold Aisle

Port to HSK

Active Mode @55C

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive Cable

400LFM

100LFM

TBD

TBD

Active 2W Cable

800LFM

200LFM

TBD

TBD

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

MCX623435MN-CDAB Specifications

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Single QSFP56 Ethernet (copper and optical)

Retention Mechanism: Thumbscrew (Pull Tab) Bracket

Capabilities

Multi-Host or Socket Direct, Crypto Disabled, No Secure Boot

Protocol Support

Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

18W

5.7W

Maximum Power

Passive Cables

23.4W

10W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle HSK to Port

Cold AislePort to HSK

Active Mode

Standby Mode @45 ° C

Active Mode @35C

Standby Mode @35C

Passive Cable

500LFM @55 ° C

100LFM

300LFM

100LFM

Active 2.2W NVIDIA Cable

700LFM @55 ° C

200LFM

300LFM

100LFM

Active 3.5W Cable

700LFM @50 ° C

300LFM

300LFM

100LFM

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Single-port QSFP56

Retention Mechanism:

Thumbscrew (Pull Tab) Bracket

Capabilities

MCX623439MC-CDAB: Multi Host or Socket Direct, Crypto Enabled, Secure Boot
MCX623439MN-CDAB: Multi Host or Socket Direct, Crypto Disables, Secure Boot

Protocol Support

Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Environmental

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

17.22W

4.3W

Maximum Power

Passive Cables

22.77W

8.1W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle HSK to Port

Cold AislePort to HSK

Active Mode @55C

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive

Cable

600LFM

100LFM

Not Supported

Not Supported

Active Cables

TBD

TBD

TBD

TBD

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Dual QSFP56 Ethernet (copper and optical)

Retention Mechanism

MCX623436A[N/C]-CDAB: Thumbscrew (Pull Tab) Bracket

MCX623436AS-CDAI: Internal Lock Bracket

Capabilities

MCX623436AC-CDAB(a): Crypto Enabled, Secure Boot, with Host Management
MCX623436AN-CDAB: Crypto Disabled, No Secure Boot, with Host Management
MCX623436AS-CDAI: Crypto Disabled, Secure Boot, with Host Management

Protocol Support

Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(b)

Passive Cables

19W

5.7W

Maximum Power

Passive Cables

26.6W

10W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle HSK to Port

Cold Aisle @35C

Port to HSK

Active Mode

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive Cable

600LFM @55C

100LFM

Not Supported

Not Supported

Active 2.2W NVIDIA Cables

1000LFM @55C

300LFM

Not Supported

Not Supported

Active 3.5W

800LFM @50C

500LFM

Not Supported

Not Supported

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C(b)

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

(a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document. Typical power for ATIS traffic load.
(b) The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Dual QSFP56 Ethernet (copper and optical)

Retention Mechanism

Thumbscrew (Pull Tab) Bracket

Capabilities

  • MCX623436MN-CDAB: Crypto disabled, Secure Boot disabled, with Multi-Host or Socket Direct

  • MCX623436MS-CDAB: Crypto disabled, Secure Boot enabled, with Multi-Host or Socket Direct

Protocol Support

Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

19W

5.7W

Maximum Power

Passive Cables

26.6W

10W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle HSK to Port

Cold AislePort to HSK

Active Mode

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive Cable

900LFM @55C

100LFM

Not Supported

Not Supported

Active 2.2W NVIDIA Cables

700LFM @50C

300LFM

Not Supported

Not Supported

Active 3.5W

800LFM @45C

500LFM

Not Supported

Not Supported

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Dual DSFP Ethernet (copper and optical)

Retention Mechanism:

Thumbscrew (Pull Tab) Bracket

Capabilities

MCX623430MS-CDAB: Crypto disabled, Secure Boot enabled, with Multi-Host or Socket Direct

Protocol Support

Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

19W

5.7W

Maximum Power

Passive Cables

26.6W

10W

Maximum power available through DSFP port: 5W

Airflow

Cable Type

Hot Aisle HSK to Port

Cold AislePort to HSK

Active Mode

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive
Cable

350LFM @55C

100LFM

150LFM

100LFM

Active 2.5W Cables

400LFM @45C

200LFM

200LFM

100LFM

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(b)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Single QSFP56 Ethernet (copper and optical)

Retention Mechanism

Thumbscrew (Pull Tab) Bracket

Capabilities

  • MCX623435AC-CDAB(a): Crypto enabled, Secure Boot enabled, with Host Management

  • MCX623435AE-CDAB: Crypto enabled, Secure Boot disabled, with Host Management

  • MCX623435AN-CDAB: Crypto disabled, Secure Boot disabled, with Host Management

Protocol Support

Ethernet: 200GBASE-CR4, 200GBASE-KR4, 200GBASE-SR4, 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate:

Ethernet

1/10/25/40/50/100/200 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

16.9W

5.6W

Maximum Power

Passive Cables

24W

11.4W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle Heatsink to Port

Cold Aisle Port to Heatsink

Active Mode @55C

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive Cable

400LFM

100LFM

250LFM

100LFM

Active 2.2W NVIDIA Cable

700LFM

200LFM

250LFM

100LFM

Active 3.5W Cable

700LFM(b)

300LFM

250LFM

100LFM

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(c)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

(a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document. Typical power for ATIS traffic load.
(b) At 50 ° C ambient, not 55 ° C.
(c) The non-operational storage temperature specifications apply to the product without its package.

Physical

Form Factor: Small Form Factor (SFF) OCP 3.0

Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm)

Connector: Single QSFP56 Ethernet (copper and optical)

Retention Mechanism

MCX623435A[N/C]-VDAB: Thumbscrew (Pull Tab) Bracket

MCX623435AS-VDAI: Internal Lock

Capabilities

  • MCX623435AC-VDAB: Crypto enabled, Secure Boot enabled, with Host Management

  • MCX623435AN-VDAB: Crypto disabled, Secure Boot disabled, with Host Management

  • MCX623435AS-VDAI: Crypto disabled, Secure Boot enabled, with Host Management

Protocol Support

Ethernet: 200GBASE-CR4, 200GBASE-KR4, 200GBASE-SR4, 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR

Data Rate

Ethernet

1/10/25/40/50/100/200 Gb/s

PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible)

Power and Airflow

Voltage: 3.3VAUX, 12V

Power

Cable Type

Active Mode

Standby Mode

Typical Power(a)

Passive Cables

16.9W

5.6W

Maximum Power

Passive Cables

24W

11.4W

Maximum power available through QSFP56 port: 5W

Airflow

Cable Type

Hot Aisle Heatsink to Port

Cold AislePort to Heatsink

Active Mode @55C

Standby Mode @45C

Active Mode @35C

Standby Mode @35C

Passive Cable

500LFM

100LFM

300LFM

100LFM

Active 4.55W Cables

750LFM(b)

600LFM

300LFM

100LFM

Environmental

Temperature

Operational

0°C to 55°C

Non-operational

-40°C to 70°C

Humidity

Operational

10% to 85% relative humidity

Non-operational

10% to 90% relative humidity(c)

Altitude (Operational)

3050m

Regulatory

Safety

CB / cTUVus / CE

EMC

CE / FCC / VCCI / ICES / RCM

RoHS

RoHS compliant

a. Typical power for ATIS traffic load.
b. At 50 ° C ambient, not 55 ° C.
c. The non-operational storage temperature specifications apply to the product without its package.

Warning

All dimensions are in millimeters. The PCB mechanical tolerance is +/- 0.13mm.

ConnectX-6 Dx SFP28/SFP56 OCP 3.0

ConnectX-6 Dx Dual-Port QSFP56 OCP 3.0

ConnectX-6 Dx Single-Port QSFP56 OCP 3.0

image2020-10-19_20-4-52.png

image2020-10-19_20-4-19.png

image2020-10-19_20-6-10.png

Warning

All dimensions are in millimeters. The bracket's mechanical tolerance is +/- 0.25mm.

Dual-port SFP28/SFP56 Thumbscrew Bracket

Dual-port QSFP56 Thumbscrew Bracket

Single-port QSFP56 Thumbscrew Bracket

image2020-10-19_20-14-22.png

© Copyright 2023, NVIDIA. Last updated on Sep 5, 2023.