Deploy Megatron-Bridge LLMs by Exporting to Inference Optimized Libraries#
Note: Support for exporting and deploying Megatron-Bridge models with TensorRT-LLM and vLLM is coming soon. Please check back for updates.
Note: Support for exporting and deploying Megatron-Bridge models with TensorRT-LLM and vLLM is coming soon. Please check back for updates.