NVIDIA Morpheus (24.06)
(Latest Version)

morpheus.stages.inference.triton_inference_stage.TritonInOut

class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]

Bases: object

Data class for model input and output configuration.

Parameters
name

Name of the input/output in the model.

bytes

Total bytes.

datatype

Triton string for datatype.

shape

Shape of input/output.

mapped_name

Name of the input/output in the pipeline.

offset

Offset, default value is 0.

ptr

Cupy cuda memory pointer for the input/output.

Attributes
ptr

Previous morpheus.stages.inference.triton_inference_stage.ShmInputWrapper
Next morpheus.stages.inference.triton_inference_stage.TritonInferenceStage
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.