ChatCompletionResponse#

class nemo_microservices.types.chat.ChatCompletionResponse(*args: Any, **kwargs: Any)

Bases: BaseModel

choices: List[ChatCompletionResponseChoice]
model: str
usage: UsageInfo
id: str | None = None
created: int | None = None
object: str | None = None
system_fingerprint: str | None = None

Represents the backend configuration that the model runs with.

Used with seed for determinism.