- class TritonInOut(name, bytes, datatype, shape, mapped_name, offset=0, ptr=None)[source]
Bases:
objectData class for model input and output configuration.
- Parameters
- namestr
Name of the input/output in the model.
- bytesint
Total bytes.
- datatypestr
Triton string for datatype.
- shapetyping.List[int]
Shape of input/output.
- mapped_namestr
Name of the input/output in the pipeline.
- offsetint
Offset, default value is 0.
- ptrcp.cuda.MemoryPointer
Cupy cuda memory pointer for the input/output.
- Attributes
- ptr
