Inference Chat Resource#
This resource corresponds to the NIM Proxy microservice’s v1/chat endpoint. Use the completions sub-resource to create chat completions.
Sync Chat Resource#
- class nemo_microservices.resources.chat.ChatResource(client: NeMoMicroservices)
Bases:
SyncAPIResource- property completions: CompletionsResource
- property with_raw_response: ChatResourceWithRawResponse
This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers
- property with_streaming_response: ChatResourceWithStreamingResponse
An alternative to .with_raw_response that doesn’t eagerly read the response body.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response
- create_from_dict(data: dict[str, object]) object
Async Chat Resource#
- class nemo_microservices.resources.chat.AsyncChatResource(client: AsyncNeMoMicroservices)
Bases:
AsyncAPIResource- property completions: AsyncCompletionsResource
- property with_raw_response: AsyncChatResourceWithRawResponse
This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers
- property with_streaming_response: AsyncChatResourceWithStreamingResponse
An alternative to .with_raw_response that doesn’t eagerly read the response body.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response
- create_from_dict(data: dict[str, object]) object