NVIDIA Morpheus (24.06)
(Latest Version)

Class LLMNodeRunner

class LLMNodeRunner

This class wraps LLMNode and is responsible for node’s execution. It also manages mapping of node’s inputs to parent and sibling nodes.

Public Functions

LLMNodeRunner(std::string name, input_mappings_t inputs, std::shared_ptr<LLMNodeBase> node)

Construct a new LLMNodeRunner object.

Parameters
  • name

  • inputs

  • node

~LLMNodeRunner()

Destroy the LLMNodeRunner object.

virtual Task<std::shared_ptr<LLMContext>> execute(std::shared_ptr<LLMContext> context)

Execute node and save outputs to context.

Parameters

context – context for node’s execution

Returns

Task>

const std::string &name() const

Get name of node runner typically same as node name.

Returns

const std::string&

const input_mappings_t &inputs() const

Get input mappings for this node.

Returns

const input_mappings_t&

const std::vector<std::string> &sibling_input_names() const

Get input names from node’s siblings.

Returns

const std::vector<std::string>&

const std::vector<std::string> &parent_input_names() const

Get input names from node’s parent.

Returns

const std::vector<std::string>&

Previous Class LLMNodeBase
Next Class LLMTaskHandler
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.