NVIDIA AI Enterprise 2.0 or later
NVIDIA AI Enterprise on bare metal has the following sets of prerequisites:
At least one NVIDIA data center GPU in a single NVIDIA AI Enterprise Compatible NVIDIA-Certified System. Recommended A100 for training and A30 for inference.
NVIDIA AI Enterprise License
Ubuntu Server 20.04 LTS, 22.04 LTS, or Red Hat Enterprise Linux 8.4 ISO
NVIDIA AI Enterprise Software:
NVIDIA AI Enterprise Driver
You may leverage the NVIDIA System Management interface (NV-SMI) management and monitoring tool for testing and benchmarking.
The following server configuration details are considered best practices:
Hyperthreading - Enabled
Power Setting or System Profile - High Performance
CPU Performance (if applicable) - Enterprise or High Throughput
Memory Mapped I/O above 4-GB - Enabled (if applicable)