LLM Inference Quick Start Recipes

Optimized deployment guides for NVIDIA hardware for the most popular open source LLMs.

TRT-LLM	vLLM
DeepSeek R1 0528 Llama-3.3-70B Llama-4-Scout	gpt-oss DeepSeek R1/V3 Llama3.3-70B Llama4-Scout Qwen3-Coder-480B-A35B GLM-4.5 GLM-4.5V

Last updated on Aug 12, 2025.