nemo_microservices.types.prompt_data_de#
Module Contents#
Classes#
API#
- class nemo_microservices.types.prompt_data_de.PromptDataDe(/, **data: Any)#
Bases:
nemo_microservices._models.BaseModel- icl_few_shot_examples: str | None#
None
A string including a set of examples. These are pre-pended to the prompt.
- inference_params: nemo_microservices.types.shared.inference_params.InferenceParams | None#
None
Parameters that influence the inference of a model.
- system_prompt: str | None#
None
The system prompt that should be applied during inference.
- system_prompt_template: str | None#
None
The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only ‘icl_few_shot_examples’