> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemoclaw/_mcp/server.

# Inference

## Docs

- [About Inference Routing](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/about-inference-routing.md): Understand how NemoClaw routes sandbox inference through OpenShell without exposing provider credentials.
- [Choose an Inference Provider](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/learn-and-choose/choose-inference-provider.md): Compare hosted, local, routed, and compatible inference providers available during NemoClaw onboarding.
- [Choose a Model](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/learn-and-choose/choose-model.md): Compare curated cloud models by task fit, latency, tool use, context, and relative cost.
- [Use NVIDIA Endpoints](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/use-nvidia-endpoints.md): Configure NemoClaw to use models hosted on NVIDIA Endpoints.
- [Use OpenRouter](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/use-openrouter.md): Configure NemoClaw to route hosted inference through OpenRouter.
- [Use OpenAI](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/use-openai.md): Configure NemoClaw to use the OpenAI API for hosted inference.
- [Use Anthropic](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/use-anthropic.md): Configure NemoClaw to use the Anthropic Messages API for hosted inference.
- [Use Google Gemini](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/use-google-gemini.md): Configure NemoClaw to use Google Gemini through its OpenAI-compatible endpoint.
- [Set Up Model Router](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/hosted-inference/set-up-model-router.md): Configure the NemoClaw host-side model router and its model pool.
- [Choose a Local Inference Server](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/choose-local-inference-server.md): Compare operator-run servers and managed runtime profiles before choosing local inference for NemoClaw.
- [Set Up Ollama](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-ollama.md): Install, connect, and configure Ollama as NemoClaw's local inference server.
- [Set Up vLLM](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-vllm.md): Connect NemoClaw to an existing vLLM server or start a managed vLLM container.
- [Set Up vLLM on Two DGX Sparks](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-vllm-on-two-dgx-sparks.md): Qualify two trusted DGX Spark systems and start NemoClaw's Experimental distributed DeepSeek V4 Flash vLLM profile.
- [Set Up vLLM on Two DGX Stations](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-vllm-on-two-dgx-stations.md): Qualify a trusted two-Station DGX GB300 pair and use NemoClaw's distributed Nemotron Ultra vLLM recipe.
- [Set Up llama.cpp](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-llama-cpp.md): Attach an existing llama.cpp server or select an experimental managed llama.cpp profile.
- [Set Up NVIDIA NIM](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/local-inference/set-up-nvidia-nim.md): Pull, start, and configure a local NVIDIA NIM container for NemoClaw inference.
- [Set Up an OpenAI-Compatible Endpoint](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/custom-endpoints/set-up-openai-compatible-endpoint.md): Connect NemoClaw to a self-hosted or custom OpenAI-compatible inference endpoint.
- [Set Up an Anthropic-Compatible Endpoint](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/custom-endpoints/set-up-anthropic-compatible-endpoint.md): Connect NemoClaw to a custom Anthropic-compatible inference endpoint.
- [Choose a Compatible Inference API](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/custom-endpoints/choose-compatible-inference-api.md): Choose the Chat Completions or Responses API for a custom OpenAI-compatible endpoint.
- [Meet Custom Endpoint Security Requirements](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/custom-endpoints/custom-endpoint-security.md): Understand credential isolation and URL validation requirements for custom NemoClaw inference endpoints.
- [Use Shared Gateway Routes](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/use-shared-gateway-routes.md): Understand how multiple NemoClaw sandboxes safely share one live OpenShell inference route.
- [View the Selected Inference Path](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/view-active-inference-route.md): Inspect a sandbox-attached native provider or the live NemoClaw-managed OpenShell inference route.
- [Switch Inference Models](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/switch-models.md): Change the model on a NemoClaw-managed inference route.
- [Switch Inference Providers](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/switch-providers.md): Move a NemoClaw-managed sandbox to another inference provider.
- [Configure Model Limits](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/configure-model-limits.md): Context-window and output-token limits for a NemoClaw-managed sandbox.
- [Configure OpenClaw Model Capabilities](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/configure-model-capabilities.md): Declare reasoning mode, reasoning effort, and input modalities for an OpenClaw model in a NemoClaw sandbox.
- [Configure Inference Timeouts](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/manage-inference/configure-inference-timeouts.md): Configure NemoClaw inference request, provider-validation, sandbox-readiness, and recovery timeouts.
- [Understand Provider Validation](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/validate-inference/understand-provider-validation.md): Understand how NemoClaw validates inference credentials, models, APIs, and streaming behavior during onboarding.
- [Verify the Sandbox Inference Route](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/validate-inference/verify-inference-route.md): Verify that a NemoClaw sandbox can reach its configured model through its selected inference provider.
- [Model Capability Audit Matrix](https://docs.nvidia.com/nemoclaw/latest/user-guide/openclaw/inference/validate-inference/audit-model-capabilities.md): Maintained matrix template for auditing NemoClaw model and provider behavior across supported agent surfaces.