> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/llms.txt. # nemoguardrails.llm.clients ## Submodules * **[`nemoguardrails.llm.clients.base`](/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/base)** * **[`nemoguardrails.llm.clients.constants`](/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/constants)** * **[`nemoguardrails.llm.clients.openai_compatible`](/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/openai_compatible)** ## Package Contents ### Classes | Name | Description | | ------------------------------------------------------------------------------------------------ | ----------- | | [`OpenAICompatibleClient`](#nemoguardrails-llm-clients-openai_compatible-OpenAICompatibleClient) | - | ### API ```python class nemoguardrails.llm.clients.OpenAICompatibleClient() ``` **Bases:** [BaseClient](/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/base#nemoguardrails-llm-clients-base-BaseClient) **`_ROUTE`** `= '/chat/completions'` --- **`provider_url`** `Optional[str]` --- ```python nemoguardrails.llm.clients.OpenAICompatibleClient._build_payload( model: str, messages: typing.List[typing.Dict[str, typing.Any]], stop: typing.Optional[typing.List[str]] = None, stream: bool = False, include_usage_in_stream: typing.Optional[bool] = None, kwargs: typing.Any = {} ) -> typing.Dict[str, typing.Any] ``` ```python nemoguardrails.llm.clients.OpenAICompatibleClient.chat_completion( model: str, messages: typing.List[typing.Dict[str, typing.Any]], stop: typing.Optional[typing.List[str]] = None, kwargs: typing.Any = {} ) -> nemoguardrails.llm.clients.base.HTTPResponse ``` async ```python nemoguardrails.llm.clients.OpenAICompatibleClient.stream_chat_completion( model: str, messages: typing.List[typing.Dict[str, typing.Any]], stop: typing.Optional[typing.List[str]] = None, kwargs: typing.Any = {} ) -> typing.AsyncGenerator[nemoguardrails.llm.clients.base.HTTPResponse, None] ``` async ## Docs - [nemoguardrails.llm.clients.base](https://docs.nvidia.com/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/base.md) - [nemoguardrails.llm.clients.constants](https://docs.nvidia.com/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/constants.md) - [nemoguardrails.llm.clients.openai_compatible](https://docs.nvidia.com/nemo/guardrails/v0.25.0/guardrails-python-sdk/nemoguardrails/llm/clients/openai_compatible.md)