- class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]
Bases:
objectData class for model input and output configuration.
- Parameters
- name
- bytes
- datatype
- shape
- mapped_name
- offset
- ptr
Name of the input/output in the model.
Total bytes.
Triton string for datatype.
Shape of input/output.
Name of the input/output in the pipeline.
Offset, default value is 0.
Cupy cuda memory pointer for the input/output.
- Attributes
- ptr
morpheus.stages.inference.triton_inference_stage.TritonInOut
(Latest Version)
Previous
morpheus.stages.inference.triton_inference_stage.ShmInputWrapper
Next
morpheus.stages.inference.triton_inference_stage.TritonInferenceStage