Is this page helpful?

`nemo_microservices.types.shared.chat_completion_response_stream_choice`#

Module Contents#

Classes#

ChatCompletionResponseStreamChoice

API#

class nemo_microservices.types.shared.chat_completion_response_stream_choice.ChatCompletionResponseStreamChoice(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

delta: nemo_microservices.types.shared.delta_message.DeltaMessage#: None

finish_reason: Optional[str]#: None

index: int#: None

logprobs: Optional[nemo_microservices.types.shared.choice_logprobs.ChoiceLogprobs]#

None

Log probability information for a chat completion choice.

This is used in both regular and streaming chat completions when logprobs=true is provided in the request.