Skip to main content

Ctrl+K

NeMo-Export-Deploy

GitHub

NeMo-Export-Deploy

GitHub

Table of Contents

🚀 NeMo Export and Deploy

Deploy NeMo Framework Models
Deploy Large Language Models
Deploy NeMo Models Using NIM LLM Containers
Deploy NeMo Models by Exporting to Inference Optimized Libraries
Deploy NeMo Models by Exporting TensorRT-LLM
Deploy NeMo Models by Exporting vLLM
Deploy NeMo Models in the Framework
Deploy NeMo Models using Ray
Send Queries to the NVIDIA Triton Server for NeMo LLMs
Deploy NeMo AutoModel LLM Models in the Framework
Deploy Hugging Face Models by Exporting to TensorRT-LLM
Deploy NeMo AutoModel LLM Models using Ray
Deploy NeMo Multimodal Models

🛠️ Development

Test NeMo Export-Deploy
Documentation Development
API Reference
- nemo_export
- nemo_deploy

API Reference
nemo_export
nemo_export.vllm

`nemo_export.vllm`#

Submodules#

nemo_export.vllm.model_loader
nemo_export.vllm.model_converters
nemo_export.vllm.model_config

previous

nemo_export

next

nemo_export.vllm.model_loader

On this page

Submodules

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.