API Reference

This page contains auto-generated API reference documentation [1].

• nemo_export
  • nemo_export.utils
    • nemo_export.utils.model_loader
    • nemo_export.utils.constants
    • nemo_export.utils._mock_import
    • nemo_export.utils.utils
    • nemo_export.utils.lora_converter
  • nemo_export.model_adapters
    • nemo_export.model_adapters.reranker
      • nemo_export.model_adapters.reranker.reranker_adapter
    • nemo_export.model_adapters.embedding
      • nemo_export.model_adapters.embedding.embedding_adapter
  • nemo_export.vllm_exporter
  • nemo_export.onnx_llm_exporter
  • nemo_export.tiktoken_tokenizer
  • nemo_export.tarutils
  • nemo_export.package_info
  • nemo_export.sentencepiece_tokenizer
• nemo_deploy
  • nemo_deploy.service
    • nemo_deploy.service.fastapi_interface_to_pytriton_multimodal
    • nemo_deploy.service.fastapi_interface_to_pytriton
  • nemo_deploy.llm
    • nemo_deploy.llm.inference
      • nemo_deploy.llm.inference.nemo_io
      • nemo_deploy.llm.inference.nemo_utils
      • nemo_deploy.llm.inference.inference_base
      • nemo_deploy.llm.inference.tron_utils
    • nemo_deploy.llm.megatronllm_deployable
    • nemo_deploy.llm.hf_deployable_ray
    • nemo_deploy.llm.hf_deployable
    • nemo_deploy.llm.query_llm
    • nemo_deploy.llm.megatronllm_deployable_ray
  • nemo_deploy.multimodal
    • nemo_deploy.multimodal.query_multimodal
    • nemo_deploy.multimodal.megatron_multimodal_deployable
    • nemo_deploy.multimodal.megatron_multimodal_deployable_ray
  • nemo_deploy.triton_deployable
  • nemo_deploy.deploy_base
  • nemo_deploy.ray_utils
  • nemo_deploy.utils
  • nemo_deploy.deploy_pytriton
  • nemo_deploy.package_info
  • nemo_deploy.deploy_ray

[1]

Created with sphinx-autodoc2