Class InferenceMemory

Base Type

Derived Types

class InferenceMemory : public morpheus::TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic data as a TensorObjects.

Subclassed by morpheus::InferenceMemoryFIL, morpheus::InferenceMemoryNLP

Public Functions

InferenceMemory(TensorIndex count)

Construct a new Inference Memory object.

Parameters

count

InferenceMemory(TensorIndex count, TensorMap &&tensors)

Construct a new Inference Memory object.

Parameters
  • count

  • tensors

bool has_input(const std::string &name) const

Checks if a tensor named name exists in tensors. Alias for has_tensor.

Parameters

name

Returns

true

Returns

false

Previous Class InferenceClientStage
Next Class InferenceMemoryFIL
© Copyright 2023, NVIDIA. Last updated on Feb 2, 2024.