Advanced#

Refer to Quickstart to deploy a NIM container. Use the following reference for additional model-specific deployment requirements.

Note

If you are new to NIM LLM and VLM, start with the Get Started documentation before configuring model-specific settings.

Model-Specific Deployment Considerations

Model-Specific Deployment Considerations

Model-Specific Deployment Considerations
GLM-5.3-Flash

Get Started with GLM-5.3-Flash

Get Started with GLM-5.3-Flash
Mistral Large 4

Deploy Mistral Large 4 with the experimental vLLM Model-Free NIM and a serving recipe.

Get Started with Mistral Large 4
Qwen3.8-Flash-Next

Get Started with Qwen3.8-Flash-Next

Get Started with Qwen3.8-Flash-Next
MiniMax M3.1 Flash

Deploy MiniMax M3.1 Flash with the experimental SGLang Model-Free NIM and a serving recipe.

Get Started with MiniMax M3.1 Flash
DeepSeek-V4.1-Flash-1017

Deploy DeepSeek-V4.1-Flash-1017 with the experimental SGLang Model-Free NIM collection and a serving recipe.

Get Started with DeepSeek-V4.1-Flash-1017
Kimi-K3

Get Started with Kimi-K3

Get Started with Kimi-K3
Beam-1.0-501B-A23B

Deploy Beam with the experimental SGLang model-free NIM and a serving recipe.

Get Started with Beam-1.0-501B-A23B