ChatCompletionResponseChoice

class nemo_microservices.types.shared.ChatCompletionResponseChoice(*args: Any, **kwargs: Any)

Bases: BaseModel

index: int

The index of the choice in the list of choices.

message: ChatCompletionMessage

A chat completion message generated by the model.

finish_reason: str | None = None

The reasons why the conversation ended.

logprobs: ChoiceLogprobs | None = None

Log probability information for a chat completion choice.

This is used in both regular and streaming chat completions when logprobs=true is provided in the request.