Related Software#
NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) fits into a broader inference and platform ecosystem. The following software products are highly relevant when you are deploying, operating, or extending LLM and VLM workloads.
Product |
Relation to NIM LLM and VLM |
|---|---|
NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) packages vLLM as its inference backend, so many request semantics and tuning concepts come directly from vLLM. |
|
The operator manages NIM deployments by using Kubernetes custom resources and is especially useful for repeatable, production-scale rollouts. |
|
Earlier VLM-specific documentation remains useful for deployments that still follow that path. Use these NIM LLM and VLM docs for the combined LLM and VLM workflow. |
Usage Guidance#
To help you choose the right tool for your specific use case, consider the following recommendations:
Use NIM LLM and VLM when your workload uses text, image, audio, or video input and you want a curated, enterprise-ready container for production inference.
Use vLLM documentation alongside NIM documentation when you need deeper, backend-specific context for passthrough arguments or upstream model-serving behavior.
Use the NIM Operator when your primary deployment target is Kubernetes and you want lifecycle automation around NIM services.