nemo_microservices.types.shared_params.guardrail_model#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared_params.guardrail_model.GuardrailModel#
Bases:
typing_extensions.TypedDict- api_key_env_var: str#
None
Optional environment variable with model’s API Key. Do not include “$”.
- cache: nemo_microservices.types.shared_params.model_cache_config.ModelCacheConfig#
None
Configuration for model caching.
- engine: typing_extensions.Required[str]#
None
- mode: typing_extensions.Literal[chat, text]#
None
Whether the mode is ‘text’ completion or ‘chat’ completion.
Allowed values are ‘chat’ or ‘text’.
- model: str#
None
The name of the model.
If not specified, it should be specified through the parameters attribute.
- parameters: Dict[str, object]#
None
- type: typing_extensions.Required[str]#
None