nemo_microservices.types.prompt_data_de_param#
Module Contents#
Classes#
API#
- class nemo_microservices.types.prompt_data_de_param.PromptDataDeParam#
Bases:
typing_extensions.TypedDict- icl_few_shot_examples: str#
None
A string including a set of examples. These are pre-pended to the prompt.
- inference_params: nemo_microservices.types.shared_params.inference_params.InferenceParams#
None
Parameters that influence the inference of a model.
- system_prompt: str#
None
The system prompt that should be applied during inference.
- system_prompt_template: str#
None
The template which will be used to compile the final prompt used for prompting the LLM. Currently supports only ‘icl_few_shot_examples’