Class PyLLMLambdaNode

Base Type

class PyLLMLambdaNode : public morpheus::llm::LLMNodeBase

Public Functions

PyLLMLambdaNode(pybind11::function fn)

~PyLLMLambdaNode() override

virtual std::vector<std::string> get_input_names() const override

Virtual method for implementing how task handler gets its input names.

Returns

std::vector<std::string>

virtual Task<std::shared_ptr<LLMContext>> execute(std::shared_ptr<LLMContext> context) override

Virtual method for implementing the execution of a node.

Parameters

context – context for node’s execution

Returns

Task>

Previous Class PyLLMEngineStage
Next Template Class PyLLMNode
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.