morpheus.stages.inference.triton_inference_stage.TritonInOut#

class TritonInOut( name, bytes, datatype, shape, mapped_name, offset=0, ptr=None, )[source]#

Bases: object

Data class for model input and output configuration.

Parameters:

namestr: Name of the input/output in the model.
bytesint: Total bytes.
datatypestr: Triton string for datatype.
shapetyping.List[int]: Shape of input/output.
mapped_namestr: Name of the input/output in the pipeline.
offsetint: Offset, default value is 0.
ptrcp.cuda.MemoryPointer: Cupy cuda memory pointer for the input/output.

Attributes:

ptr