Class InferenceMemory

• Defined in File inference_memory.hpp

Base Type

• public morpheus::TensorMemory (Class TensorMemory)

Derived Types

• public morpheus::InferenceMemoryFIL (Class InferenceMemoryFIL)

• public morpheus::InferenceMemoryNLP (Class InferenceMemoryNLP)

class InferenceMemory : public morpheus::TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic data as a TensorObjects.

Subclassed by morpheus::InferenceMemoryFIL, morpheus::InferenceMemoryNLP

Public Functions

InferenceMemory(size_t count)

Construct a new Inference Memory object.

Parameters

count –

InferenceMemory(size_t count, tensor_map_t &&tensors)

Construct a new Inference Memory object.

Parameters

• count –

• tensors –

bool has_input(const std::string &name) const

Checks if a tensor named name exists in tensors

Parameters

name –

Returns

true

Returns

false