> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/llms.txt.
> For full documentation content, see https://docs.nvidia.com/nemo/guardrails/llms-full.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/guardrails/_mcp/server.

# nemoguardrails.llm.clients.openai_compatible

## Module Contents

### Classes

| Name                                                                                             | Description |
| ------------------------------------------------------------------------------------------------ | ----------- |
| [`OpenAICompatibleClient`](#nemoguardrails-llm-clients-openai_compatible-OpenAICompatibleClient) | -           |

### API

```python
class nemoguardrails.llm.clients.openai_compatible.OpenAICompatibleClient()
```

**Bases:** [BaseClient](/guardrails-python-sdk/nemoguardrails/llm/clients/base#nemoguardrails-llm-clients-base-BaseClient)

```python
nemoguardrails.llm.clients.openai_compatible.OpenAICompatibleClient._build_payload(
    model: str,
    messages: typing.List[typing.Dict[str, typing.Any]],
    stop: typing.Optional[typing.List[str]] = None,
    stream: bool = False,
    include_usage_in_stream: typing.Optional[bool] = None,
    kwargs: typing.Any = {}
) -> typing.Dict[str, typing.Any]
```

```python
nemoguardrails.llm.clients.openai_compatible.OpenAICompatibleClient.chat_completion(
    model: str,
    messages: typing.List[typing.Dict[str, typing.Any]],
    stop: typing.Optional[typing.List[str]] = None,
    kwargs: typing.Any = {}
) -> nemoguardrails.llm.clients.base.HTTPResponse
```

async

```python
nemoguardrails.llm.clients.openai_compatible.OpenAICompatibleClient.stream_chat_completion(
    model: str,
    messages: typing.List[typing.Dict[str, typing.Any]],
    stop: typing.Optional[typing.List[str]] = None,
    kwargs: typing.Any = {}
) -> typing.AsyncGenerator[nemoguardrails.llm.clients.base.HTTPResponse, None]
```

async