`nemo_microservices.types.shared.task_prompt`#

Module Contents#

nemo_microservices.types.shared.task_prompt.Message: typing_extensions.TypeAlias#: None

class nemo_microservices.types.shared.task_prompt.TaskPrompt(/, **data: Any)#

content: str | None#

None

The content of the prompt, if it’s a string.

max_length: int | None#

None

The maximum length of the prompt in number of characters.

max_tokens: int | None#

None

The maximum number of tokens that can be generated in the chat completion.

messages: List[nemo_microservices.types.shared.task_prompt.Message] | None#

None

The list of messages included in the prompt. Used for chat models.

mode: str | None#

None

Corresponds to the prompting_mode for which this prompt is fetched.

Default is ‘standard’.

models: List[str] | None#

None

If specified, the prompt will be used only for the given LLM engines/models.

The format is a list of strings with the format: or /.

output_parser: str | None#

None

The name of the output parser to use for this prompt.

stop: List[str] | None#

None

If specified, will be configure stop tokens for models that support this.

task: str#

None

The id of the task associated with this prompt.