Support Matrix
About Model Profiles
NVIDIA NIM microservices use model engines tuned for specific GPU models, GPU counts, precision, and other settings. These combinations are called model profiles. Each profile has a unique 64-character hexadecimal profile ID. The NIM selects a profile automatically based on available GPUs or can use a profile ID that you specify.
The model manifest is stored at /opt/nim/etc/default/model_manifest.yaml in the container.
NVIDIA Llama 3.1 NemoGuard 8B ContentSafety Model Profiles
The model requires 48 GB of GPU memory. NVIDIA developed and tested the microservice using these GPUs:
- B200
- H200
- H100
- H100 NVL
- A100
- A100 SXM4 40 GB
- A10G
- L40S
- A6000
You can use one GPU with the required capacity or two GPUs that meet the capacity. For details about locally buildable and generic model profiles, see NIM for LLMs model profiles.