nemo_microservices.types.shared.guardrail_model#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.guardrail_model.GuardrailModel(/, **data: typing.Any)#
Bases:
nemo_microservices._models.BaseModel- api_key_env_var: Optional[str]#
None
Optional environment variable with model’s API Key. Do not include “$”.
- cache: Optional[nemo_microservices.types.shared.model_cache_config.ModelCacheConfig]#
None
Configuration for model caching.
- engine: str#
None
- mode: Optional[typing_extensions.Literal[chat, text]]#
None
Whether the mode is ‘text’ completion or ‘chat’ completion.
Allowed values are ‘chat’ or ‘text’.
- model: Optional[str]#
None
The name of the model.
If not specified, it should be specified through the parameters attribute.
- parameters: Optional[Dict[str, object]]#
None
- type: str#
None