NVIDIA AI Enterprise 2.0 or later
NVIDIA AI Enterprise on bare metal has the following sets of prerequisites:
At least one NVIDIA data center GPU in a single NVIDIA AI Enterprise Compatible NVIDIA-Certified System. Recommended A100 for training and A30 for inference.
NVIDIA AI Enterprise License
Ubuntu Server 20.04 or Red Hat Enterprise Linux 8.4 ISO
NVIDIA AI Enterprise Software:
NVIDIA AI Enterprise Driver
You may leverage the NVIDIA System Management interface (NV-SMI) management and monitoring tool for testing and benchmarking.
The following server configuration details are considered best practices:
Hyperthreading - Enabled
Power Setting or System Profile - High Performance
CPU Performance (if applicable) - Enterprise or High Throughput
Memory Mapped I/O above 4-GB - Enabled (if applicable)