API Reference

This page contains auto-generated API reference documentation [1].

• nemo_export
  • nemo_export.vllm
    • nemo_export.vllm.model_loader
    • nemo_export.vllm.model_converters
    • nemo_export.vllm.model_config
  • nemo_export.trt_llm
    • nemo_export.trt_llm.qnemo
      • nemo_export.trt_llm.qnemo.utils
      • nemo_export.trt_llm.qnemo.qnemo_to_tensorrt_llm
    • nemo_export.trt_llm.nemo_ckpt_loader
      • nemo_export.trt_llm.nemo_ckpt_loader.nemo_file
    • nemo_export.trt_llm.utils
    • nemo_export.trt_llm.tensorrt_llm_run
  • nemo_export.multimodal
    • nemo_export.multimodal.build
    • nemo_export.multimodal.run
  • nemo_export.utils
    • nemo_export.utils.constants
    • nemo_export.utils.utils
    • nemo_export.utils.model_loader
    • nemo_export.utils.lora_converter
    • nemo_export.utils._mock_import
  • nemo_export.tensorrt_llm_deployable_ray
  • nemo_export.vllm_exporter
  • nemo_export.onnx_llm_exporter
  • nemo_export.tensorrt_llm
  • nemo_export.tensorrt_mm_exporter
  • nemo_export.tiktoken_tokenizer
  • nemo_export.package_info
  • nemo_export.sentencepiece_tokenizer
  • nemo_export.tarutils
  • nemo_export.vllm_hf_exporter
• nemo_deploy
  • nemo_deploy.multimodal
    • nemo_deploy.multimodal.query_multimodal
  • nemo_deploy.nlp
    • nemo_deploy.nlp.trtllm_api_deployable
    • nemo_deploy.nlp.megatronllm_deployable_ray
    • nemo_deploy.nlp.query_llm
    • nemo_deploy.nlp.megatronllm_deployable
    • nemo_deploy.nlp.hf_deployable_ray
    • nemo_deploy.nlp.hf_deployable
  • nemo_deploy.service
    • nemo_deploy.service.fastapi_interface_to_pytriton
    • nemo_deploy.service.rest_model_api
  • nemo_deploy.deploy_base
  • nemo_deploy.utils
  • nemo_deploy.deploy_pytriton
  • nemo_deploy.ray_utils
  • nemo_deploy.deploy_ray
  • nemo_deploy.package_info
  • nemo_deploy.triton_deployable

[1]

Created with sphinx-autodoc2