NVIDIA Morpheus (24.06)
(Latest Version)

Class InferenceMemory

Base Type

Derived Types

class InferenceMemory : public morpheus::TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic data as a TensorObjects.

Subclassed by morpheus::InferenceMemoryFIL, morpheus::InferenceMemoryNLP

Public Functions

InferenceMemory(TensorIndex count)

Construct a new Inference Memory object.

Parameters

count

InferenceMemory(TensorIndex count, TensorMap &&tensors)

Construct a new Inference Memory object.

Parameters
  • count

  • tensors

bool has_input(const std::string &name) const

Checks if a tensor named name exists in tensors. Alias for has_tensor.

Parameters

name

Returns

true

Returns

false

Previous Template Class InferenceClientStage
Next Class InferenceMemoryFIL
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.