nemo_microservices.types.shared.guardrail_model#

Module Contents#

Classes#

API#

class nemo_microservices.types.shared.guardrail_model.GuardrailModel(/, **data: Any)#

Bases: nemo_microservices._models.BaseModel

api_key_env_var: str | None#

None

Optional environment variable with model’s API Key. Do not include “$”.

engine: str#

None

mode: typing_extensions.Literal[chat, text] | None#

None

Whether the mode is ‘text’ completion or ‘chat’ completion.

Allowed values are ‘chat’ or ‘text’.

model: str | None#

None

The name of the model.

If not specified, it should be specified through the parameters attribute.

parameters: Dict[str, object] | None#

None

reasoning_config: nemo_microservices.types.shared.reasoning_model_config.ReasoningModelConfig | None#

None

Configuration for reasoning models/LLMs, including start and end tokens for reasoning traces.

type: str#

None