Is this page helpful?

nemo_microservices.types.prompt_data_de#

Module Contents#

Classes#

PromptDataDe

API#

class nemo_microservices.types.prompt_data_de.PromptDataDe(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

icl_few_shot_examples: Optional[str]#

None

A string including a set of examples. These are pre-pended to the prompt.

inference_params: Optional[nemo_microservices.types.shared.inference_params.InferenceParams]#

None

Parameters that influence the inference of a model.

system_prompt: Optional[str]#

None

The system prompt that should be applied during inference.

system_prompt_template: Optional[str]#

None

The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only ‘icl_few_shot_examples’