nemo_deploy

Subpackages

• nemo_deploy.multimodal
  • nemo_deploy.multimodal.nemo_multimodal_deployable
  • nemo_deploy.multimodal.query_multimodal
• nemo_deploy.nlp
  • nemo_deploy.nlp.hf_deployable
  • nemo_deploy.nlp.hf_deployable_ray
  • nemo_deploy.nlp.megatronllm_deployable
  • nemo_deploy.nlp.megatronllm_deployable_ray
  • nemo_deploy.nlp.query_llm
  • nemo_deploy.nlp.trtllm_api_deployable
• nemo_deploy.service
  • nemo_deploy.service.fastapi_interface_to_pytriton

Submodules

• nemo_deploy.deploy_base
• nemo_deploy.deploy_pytriton
• nemo_deploy.deploy_ray
• nemo_deploy.package_info
• nemo_deploy.ray_utils
• nemo_deploy.triton_deployable
• nemo_deploy.utils

Package Contents

Data

__all__

API

nemo_deploy.__all__ = ['DeployBase', 'DeployPyTriton', 'ITritonDeployable', '__version__', '__package_name__']