Platform Support#

NIM Microservices#

NVIDIA NIM Operator supports the following NIM microservices.

Microservice

Version

Documentation

NVIDIA NIM for LLMs

v1.x.x

Support Matrix

NeMo Retriever Text Embedding NIM

v1.x.x

Support Matrix

NeMo Retriever Text Reranking NIM

v1.x.x

Support Matrix

Operating Systems and Kubernetes Platforms#

NVIDIA NIM Operator supports NVIDIA GPU Operator v24.3.0 or higher. Refer to Supported Operating Systems and Kubernetes Platforms in the GPU Operator documentation for supported operating systems and Kubernetes platforms:

Command-Line Tools#

Tool

Installation Documentation

kubectl (match cluster version)

Refer to Install Tools in the Kubernetes documentation for more information.

Helm v3 and higher

Refer to Install Helm in the Helm documentation for more information.