(Latest Version)

morpheus.stages.inference.triton_inference_stage.TritonInOut

class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]

Bases: object

Data class for model input and output configuration.

Parameters
namestr

Name of the input/output in the model.

bytesint

Total bytes.

datatypestr

Triton string for datatype.

shapetyping.List[int]

Shape of input/output.

mapped_namestr

Name of the input/output in the pipeline.

offsetint

Offset, default value is 0.

ptrcp.cuda.MemoryPointer

Cupy cuda memory pointer for the input/output.

Attributes
ptr

© Copyright 2023, NVIDIA. Last updated on Apr 11, 2023.