Class InferenceMemory

• Defined in File inference_memory.hpp

Inheritance Relationships

Base Type

• public morpheus::TensorMemory (Class TensorMemory)

Derived Types

• public morpheus::InferenceMemoryFIL (Class InferenceMemoryFIL)

• public morpheus::InferenceMemoryNLP (Class InferenceMemoryNLP)

Class Documentation

class InferenceMemory : public morpheus::TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic data as a TensorObjects.

Subclassed by morpheus::InferenceMemoryFIL, morpheus::InferenceMemoryNLP

Public Functions

InferenceMemory(TensorIndex count)

Construct a new Inference Memory object.

Parameters:

count –

InferenceMemory(TensorIndex count, TensorMap &&tensors)

Construct a new Inference Memory object.

Parameters:

• count –

• tensors –

bool has_input(const std::string &name) const

Checks if a tensor named name exists in tensors. Alias for has_tensor.

Parameters:

name –

Returns:

true

Returns:

false