NVIDIA AI Enterprise 2.0 or later

NVIDIA AI Enterprise on bare metal has the following sets of prerequisites:

  • At least one NVIDIA data center GPU in a single NVIDIA AI Enterprise Compatible NVIDIA-Certified System. Recommended A100 for training and A30 for inference.

  • NVIDIA AI Enterprise License

  • Ubuntu Server 20.04 LTS, 22.04 LTS, or Red Hat Enterprise Linux 8.4 ISO

  • NVIDIA AI Enterprise Software:

    • NVIDIA AI Enterprise Driver

You may leverage the NVIDIA System Management interface (NV-SMI) management and monitoring tool for testing and benchmarking.

The following server configuration details are considered best practices:

  • Hyperthreading - Enabled

  • Power Setting or System Profile - High Performance

  • CPU Performance (if applicable) - Enterprise or High Throughput

  • Memory Mapped I/O above 4-GB - Enabled (if applicable)

© Copyright 2022-2023, NVIDIA. Last updated on Nov 7, 2023.