Support Matrix#
NVIDIA NemoGuard JailbreakDetect NIM uses a single generic model profile. The container uses an embedding model that can use GPU acceleration or run on CPU and a classification model that uses CPU only.
GPU |
Precision |
# of GPUs |
Disk Space |
|---|---|---|---|
B200, H200, H100, A100, A100 40GB, L40S, A10G, H100NVL, H200NVL, GH200 96 GB |
BF16 |
1 |
527.03 MB |