Struct InferenceMemoryInterfaceProxy

• Defined in File inference_memory.hpp

Inheritance Relationships

Base Type

• public morpheus::TensorMemoryInterfaceProxy (Struct TensorMemoryInterfaceProxy)

Derived Types

• public morpheus::InferenceMemoryFILInterfaceProxy (Struct InferenceMemoryFILInterfaceProxy)

• public morpheus::InferenceMemoryNLPInterfaceProxy (Struct InferenceMemoryNLPInterfaceProxy)

Struct Documentation

struct InferenceMemoryInterfaceProxy : public morpheus::TensorMemoryInterfaceProxy

Interface proxy, used to insulate python bindings.

Subclassed by morpheus::InferenceMemoryFILInterfaceProxy, morpheus::InferenceMemoryNLPInterfaceProxy

Public Static Functions

static std::shared_ptr<InferenceMemory> init(

TensorIndex count,

pybind11::object &tensors

)

Create and initialize a InferenceMemory object, and return a shared pointer to the result. Each array in tensors should be of length count.

Parameters:

• count – : Lenght of each array in tensors

• tensors – : Map of string on to cupy arrays

Returns:

std::shared_ptr<InferenceMemory>