Class LLMNodeBase

• Defined in File llm_node_base.hpp

Inheritance Relationships

Derived Types

• public morpheus::llm::LLMLambdaNode< ReturnT, ArgsT > (Template Class LLMLambdaNode)

• public morpheus::llm::LLMNode (Class LLMNode)

• public morpheus::llm::PyLLMLambdaNode (Class PyLLMLambdaNode)

• public morpheus::llm::PyLLMNodeBase< BaseT > (Template Class PyLLMNodeBase)

Class Documentation

class LLMNodeBase

Base class for LLMNode.

Subclassed by morpheus::llm::LLMLambdaNode< ReturnT, ArgsT >, morpheus::llm::LLMNode, morpheus::llm::PyLLMLambdaNode, morpheus::llm::PyLLMNodeBase< BaseT >

Public Functions

virtual ~LLMNodeBase() = default

Destroy the LLMNodeBase object.

virtual std::vector<std::string> get_input_names() const = 0

Virtual method for implementing how task handler gets its input names.

Returns:

std::vector<std::string>

virtual Task<std::shared_ptr<LLMContext>> execute(

std::shared_ptr<LLMContext> context

) = 0

Virtual method for implementing the execution of a node.

Parameters:

context – context for node’s execution

Returns:

Task<std::shared_ptr<LLMContext>>