nemo_deploy.deploy_base#
Module Contents#
Classes#
Data#
API#
- nemo_deploy.deploy_base.LOGGER = 'getLogger(...)'#
- class nemo_deploy.deploy_base.DeployBase(
- triton_model_name: str,
- triton_model_version: int = 1,
- model=None,
- max_batch_size: int = 128,
- http_port: int = 8000,
- grpc_port: int = 8001,
- address='0.0.0.0',
- allow_grpc=True,
- allow_http=True,
- streaming=False,
Bases:
abc.ABC- abstractmethod deploy()#
- abstractmethod serve()#
- abstractmethod run()#
- abstractmethod stop()#
- _is_model_deployable()#