morpheus.stages.inference.triton_inference_stage.TritonInOut
NVIDIA Docs Hub  NVIDIA Morpheus  NVIDIA Morpheus  morpheus.stages.inference.triton_inference_stage.TritonInOut
class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]

Bases: object

Data class for model input and output configuration.

Parameters
namestr

Name of the input/output in the model.
bytesint

Total bytes.
datatypestr

Triton string for datatype.
shapetyping.List[int]

Shape of input/output.
mapped_namestr

Name of the input/output in the pipeline.
offsetint

Offset, default value is 0.
ptrcp.cuda.MemoryPointer

Cupy cuda memory pointer for the input/output.
Attributes
ptr

© Copyright 2023, NVIDIA. Last updated on Apr 19, 2023.