> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# Configure Models

Configure your model with the inference backend of your choice.

NeMo Gym uses the [Responses API](https://developers.openai.com/api/reference/resources/responses/methods/create) as its native schema because it natively represents tool calls, multi-turn conversations, and structured outputs. NeMo Gym provides middleware to automatically convert other protocols — Chat Completions and Anthropic Messages — into Responses format.

For training, use a backend that returns token IDs and log probabilities (marked with

training

below).

## Available Backends

#### [OpenAI](/model-server/openai)

Use OpenAI models.

cloud

#### [Azure OpenAI](/model-server/azure-openai)

Use models hosted on Azure OpenAI deployments.

cloud

#### [Inference Providers](/model-server/inference-providers)

Use hosted providers like Fireworks, Together.ai, OpenRouter, and more.

cloud

#### [vLLM](/model-server/vllm)

Connect to a vLLM server you start and manage yourself.

self-hosted

training

#### [Local vLLM](/model-server/local-vllm)

Let NeMo Gym launch and manage the vLLM server for you.

self-hosted

gym-managed

training

#### [Local vLLM Proxy](/model-server/local-vllm-proxy)

Serve multiple request-time configs (e.g. reasoning on/off) from one Local vLLM deployment.

self-hosted

gym-managed

training

## Observe model calls

#### [Model-call capture](/model-server/model-call-capture)

Record per-rollout model requests, responses, token usage, latency, and correlation evidence.

observability

## Protocols

Every backend above also exposes these conversion dialects on the same model server:

#### [Anthropic Messages](/model-server/anthropic-messages)

Run Anthropic-native harnesses like Claude Code against any Gym model server via `POST /v1/messages`.

claude

dialect