morpheus.messages.tensor_memory.TensorMemory

class TensorMemory(*args, **kwargs)[source]

Bases: morpheus.messages.message_base.MessageData

This is a base container class for data that will be used for inference stages. This class is designed to hold generic tensor data in cupy arrays.

Parameters
countint

Number of inference inputs.

inputstyping.Dict[str, cupy.ndarray]

Inference inputs to model.

© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.