Class ResponseMemory

Base Type

Derived Type

class ResponseMemory : public morpheus::TensorMemory

Output memory block holding the results of inference.

Subclassed by morpheus::ResponseMemoryProbs

Public Functions

ResponseMemory(TensorIndex count)

Construct a new Response Memory object.

Parameters

count

ResponseMemory(TensorIndex count, TensorMap &&tensors)

Construct a new Response Memory object.

Parameters
  • count

  • tensors

bool has_output(const std::string &name) const

Checks if a tensor named name exists in tensors. Alias for has_tensor.

Parameters

name

Returns

true

Returns

false

Previous Template Class PreprocessNLPStage
Next Class ResponseMemoryProbs
© Copyright 2024, NVIDIA. Last updated on Apr 11, 2024.