nemo_microservices.types.shared_params.guardrail_model#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared_params.guardrail_model.GuardrailModel#
Bases:
typing_extensions.TypedDict- api_key_env_var: str#
None
Optional environment variable with model’s API Key. Do not include “$”.
- engine: typing_extensions.Required[str]#
None
- mode: typing_extensions.Literal[chat, text]#
None
Whether the mode is ‘text’ completion or ‘chat’ completion.
Allowed values are ‘chat’ or ‘text’.
- model: str#
None
The name of the model.
If not specified, it should be specified through the parameters attribute.
- parameters: Dict[str, object]#
None
- reasoning_config: nemo_microservices.types.shared_params.reasoning_model_config.ReasoningModelConfig#
None
Configuration for reasoning models/LLMs, including start and end tokens for reasoning traces.
- type: typing_extensions.Required[str]#
None