morpheus.messages.multi_inference_message.InferenceMemory

class InferenceMemory(*args, **kwargs)[source]

This is a base container class for data that will be used for inference stages. This class is designed to hold generic tensor data in cupy arrays.