nemo_microservices.types.shared.prompt_data#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.prompt_data.PromptData(/, **data: typing.Any)#
Bases:
nemo_microservices._models.BaseModel- icl_few_shot_examples: Optional[str]#
None
Example input-output pairs that guide the model in understanding the desired task format and behavior.
- inference_params: Optional[nemo_microservices.types.shared.inference_params.InferenceParams]#
None
Parameters that influence the inference of a model.
- reasoning_params: Optional[nemo_microservices.types.shared.reasoning_params.ReasoningParams]#
None
Custom settings that control the model’s reasoning behavior.
- system_prompt: Optional[str]#
None
Initial instructions that define the model’s role and behavior for the conversation.
- system_prompt_template: Optional[str]#
None
The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only ‘icl_few_shot_examples’