PromptData

class nemo_microservices.types.shared.PromptData(*args: Any, **kwargs: Any)

Bases: BaseModel

icl_few_shot_examples: str | None = None

Example input-output pairs that guide the model in understanding the desired task format and behavior.

inference_params: InferenceParams | None = None

Parameters that influence the inference of a model.

reasoning_params: ReasoningParams | None = None

Custom settings that control the model’s reasoning behavior.

system_prompt: str | None = None

Initial instructions that define the model’s role and behavior for the conversation.

system_prompt_template: str | None = None

The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only {{icl_few_shot_examples}}