Platform Support#
NIM Microservices#
NVIDIA NIM Operator supports the following NIM microservices.
Microservice |
Version |
Documentation |
---|---|---|
NVIDIA NIM for LLMs |
v1.x.x |
|
NeMo Retriever Text Embedding NIM |
v1.x.x |
|
NeMo Retriever Text Reranking NIM |
v1.x.x |
Operating Systems and Kubernetes Platforms#
NVIDIA NIM Operator supports NVIDIA GPU Operator v24.3.0 or higher. Refer to Supported Operating Systems and Kubernetes Platforms in the GPU Operator documentation for supported operating systems and Kubernetes platforms:
Command-Line Tools#
Tool |
Installation Documentation |
---|---|
kubectl (match cluster version) |
Refer to Install Tools in the Kubernetes documentation for more information. |
Helm v3 and higher |
Refer to Install Helm in the Helm documentation for more information. |