Class LLMNodeBase
Defined in File llm_node_base.hpp
Derived Types
public morpheus::llm::LLMLambdaNode< ReturnT, ArgsT >
(Template Class LLMLambdaNode)public morpheus::llm::LLMNode
(Class LLMNode)public morpheus::llm::PyLLMLambdaNode
(Class PyLLMLambdaNode)public morpheus::llm::PyLLMNodeBase< BaseT >
(Template Class PyLLMNodeBase)
-
class LLMNodeBase
Base class for LLMNode.
Subclassed by morpheus::llm::LLMLambdaNode< ReturnT, ArgsT >, morpheus::llm::LLMNode, morpheus::llm::PyLLMLambdaNode, morpheus::llm::PyLLMNodeBase< BaseT >
Public Functions
- virtual ~LLMNodeBase() = default
Destroy the LLMNodeBase object.
-
virtual std::vector<std::string> get_input_names() const = 0
Virtual method for implementing how task handler gets its input names.
- Returns
std::vector<std::string>
Virtual method for implementing the execution of a node.
- Parameters
- Returns
context – context for node’s execution