nemo_microservices.types.shared_params.prompt_data#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared_params.prompt_data.PromptData#
Bases:
typing_extensions.TypedDict- icl_few_shot_examples: str#
None
Example input-output pairs that guide the model in understanding the desired task format and behavior.
- inference_params: nemo_microservices.types.shared_params.inference_params.InferenceParams#
None
Parameters that influence the inference of a model.
- reasoning_params: nemo_microservices.types.shared_params.reasoning_params.ReasoningParams#
None
Custom settings that control the model’s reasoning behavior.
- system_prompt: str#
None
Initial instructions that define the model’s role and behavior for the conversation.
- system_prompt_template: str#
None
The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only ‘icl_few_shot_examples’