morpheus.stages.inference.triton_inference_stage.TritonInOut
- class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]
Bases:
objectData class for model input and output configuration.
- Parameters
- namestr
- bytesint
- datatypestr
- shapetyping.List[int]
- mapped_namestr
- offsetint
- ptrcp.cuda.MemoryPointer
Name of the input/output in the model.
Total bytes.
Triton string for datatype.
Shape of input/output.
Name of the input/output in the pipeline.
Offset, default value is 0.
Cupy cuda memory pointer for the input/output.
- Attributes
- ptr