Platform Support
NIM Microservices
NVIDIA NIM Operator supports the following NIM microservices.
Microservice |
Version |
Documentation |
|---|---|---|
NVIDIA NIM for LLMs |
v1.x.x |
|
NeMo Retriever Text Embedding NIM |
v1.x.x |
|
NeMo Retriever Text Reranking NIM |
v1.x.x |
Operating Systems and Kubernetes Platforms
NVIDIA NIM Operator supports NVIDIA GPU Operator v24.3.0 or higher. Refer to Supported Operating Systems and Kubernetes Platforms in the GPU Operator documentation for supported operating systems and Kubernetes platforms:
Command-Line Tools
Tool |
Installation Documentation |
|---|---|
kubectl (match cluster version) |
Refer to Install Tools in the Kubernetes documentation for more information. |
Helm v3 and higher |
Refer to Install Helm in the Helm documentation for more information. |