PromptDataDe

class nemo_microservices.types.PromptDataDe(*args: Any, **kwargs: Any)

Bases: BaseModel

icl_few_shot_examples: str | None = None

A string including a set of examples. These are pre-pended to the prompt.

inference_params: InferenceParams | None = None

Parameters that influence the inference of a model.

system_prompt: str | None = None

The system prompt that should be applied during inference.

system_prompt_template: str | None = None

The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only {{icl_few_shot_examples}}