morpheus_llm.llm.nodes.llm_generate_node.LLMGenerateNode
- class LLMGenerateNode(llm_client, return_exceptions=False)[source]
Bases:
morpheus_llm._lib.llm.LLMNodeBase
Generates responses from an LLM using the provided
llm_client
instance based on prompts provided as input from upstream nodes.Methods
execute
(self, context)Execute the current node with the given context
instance.get_input_names
(self)Get the input names for the node. - async execute(self: morpheus_llm._lib.llm.LLMNodeBase, context: morpheus_llm._lib.llm.LLMContext) → Awaitable[morpheus_llm._lib.llm.LLMContext][source]
Execute the current node with the given
context
instance.All inputs for the given node should be fetched from the context, typically by calling either
context.get_inputs
to fetch all inputs as adict
, orcontext.get_input
to fetch a specific input.Similarly the output of the node is written to the context using
context.set_output
.- Parameters
- context
morpheus._lib.llm.LLMContext
Context instance to use for the execution
- context
- get_input_names(self: morpheus_llm._lib.llm.LLMNodeBase) → List[str][source]
Get the input names for the node.
- Returns
- list[str]
The input names for the node