nemo_deploy.triton_deployable

Module Contents

Classes

ITritonDeployable

API

class nemo_deploy.triton_deployable.ITritonDeployable

Bases: abc.ABC

abstractmethod get_triton_input()

abstractmethod get_triton_output()

abstractmethod triton_infer_fn(**inputs: numpy.ndarray)