morpheus.llm.nodes.prompt_template_node.PromptTemplateNode
- class PromptTemplateNode(template, template_format='f-string')[source]
Bases:
morpheus._lib.llm.LLMNodeBase
Populates a template string with the values from the upstream node.
- Parameters
- template
- template_format
The template string to populate.
The format of the template string. Must be one of: f-string, jinja.
Methods
execute
(self, context)Execute the current node with the given context
instance.get_input_names
(self)Get the input names for the node. - async execute(self: morpheus._lib.llm.LLMNodeBase, context: morpheus._lib.llm.LLMContext) → Awaitable[morpheus._lib.llm.LLMContext][source]
Execute the current node with the given
context
instance.All inputs for the given node should be fetched from the context, typically by calling either
context.get_inputs
to fetch all inputs as adict
, orcontext.get_input
to fetch a specific input.Similarly the output of the node is written to the context using
context.set_output
.- Parameters
-
context :
morpheus._lib.llm.LLMContext
Context instance to use for the execution
-
context :
- get_input_names(self: morpheus._lib.llm.LLMNodeBase) → List[str][source]
Get the input names for the node.
- Returns
- list[str]
The input names for the node