GuardrailModel

class nemo_microservices.types.shared.GuardrailModel(*args: Any, **kwargs: Any)

Bases: BaseModel

engine: str

type: str

api_key_env_var: str | None = None

Optional environment variable with model’s API Key. Do not include “$”.

mode: Literal['chat', 'text'] | None = None

Whether the mode is ‘text’ completion or ‘chat’ completion.

Allowed values are ‘chat’ or ‘text’.

model: str | None = None

The name of the model.

If not specified, it should be specified through the parameters attribute.

parameters: object | None = None

reasoning_config: ReasoningModelConfig | None = None

Configuration for reasoning models/LLMs, including start and end tokens for reasoning traces.