Class LLMNodeRunner

class LLMNodeRunner

This class wraps LLMNode and is responsible for node’s execution. It also manages mapping of node’s inputs to parent and sibling nodes.

Public Functions

LLMNodeRunner(std::string name, input_mappings_t inputs, std::shared_ptr<LLMNodeBase> node)

Construct a new LLMNodeRunner object.

Parameters
  • name

  • inputs

  • node

~LLMNodeRunner()

Destroy the LLMNodeRunner object.

virtual Task<std::shared_ptr<LLMContext>> execute(std::shared_ptr<LLMContext> context)

Execute node and save outputs to context.

Parameters

context – context for node’s execution

Returns

Task>

const std::string &name() const

Get name of node runner typically same as node name.

Returns

const std::string&

const input_mappings_t &inputs() const

Get input mappings for this node.

Returns

const input_mappings_t&

const std::vector<std::string> &sibling_input_names() const

Get input names from node’s siblings.

Returns

const std::vector<std::string>&

const std::vector<std::string> &parent_input_names() const

Get input names from node’s parent.

Returns

const std::vector<std::string>&

Previous Class LLMNodeBase
Next Class LLMTaskHandler
© Copyright 2023, NVIDIA. Last updated on Feb 2, 2024.