morpheus_llm.llm.nodes.llm_generate_node.LLMGenerateNode#

class LLMGenerateNode(llm_client, return_exceptions=False)[source]#

Bases: LLMNodeBase

Generates responses from an LLM using the provided llm_client instance based on prompts provided as input from upstream nodes.

Methods

`execute`(self, context)	Execute the current node with the given `context` instance.
`get_input_names`(self)	Get the input names for the node.

async execute( self: morpheus_llm._lib.llm.LLMNodeBase, context: morpheus_llm._lib.llm.LLMContext, ) → Awaitable[morpheus_llm._lib.llm.LLMContext][source]#

Execute the current node with the given context instance.

All inputs for the given node should be fetched from the context, typically by calling either context.get_inputs to fetch all inputs as a dict, or context.get_input to fetch a specific input.

Similarly the output of the node is written to the context using context.set_output.

Parameters:

contextmorpheus._lib.llm.LLMContext: Context instance to use for the execution

get_input_names( self: morpheus_llm._lib.llm.LLMNodeBase, ) → list[str][source]#

Get the input names for the node.

Returns:

list[str]: The input names for the node