InferenceCustom Endpoints

Set Up an Anthropic-Compatible Endpoint

View as Markdown

Use the custom Anthropic-compatible provider to configure a custom base URL and model with COMPATIBLE_ANTHROPIC_API_KEY. The runtime API differs by agent capability.

Run Onboarding

Start the onboard wizard.

$nemo-deepagents onboard

Select Other Anthropic-compatible endpoint. Enter the endpoint base URL, model ID, and API key when prompted. Use any non-empty placeholder such as dummy when the endpoint does not require authentication.

Understand Deep Agents Routing

Deep Agents Code supports only OpenAI-compatible inference for this provider. NemoClaw validates /v1/chat/completions, coerces the route to openai-completions, and writes https://inference.local/v1 as the provider base URL in /sandbox/.deepagents/config.toml.

If the endpoint implements only Anthropic Messages, onboarding stops instead of creating a Deep Agents sandbox with an unusable runtime route.

Run Non-Interactive Onboarding

Set NEMOCLAW_PROVIDER=anthropicCompatible and provide the endpoint URL, model, and credential.

$NEMOCLAW_PROVIDER=anthropicCompatible \
>  NEMOCLAW_ENDPOINT_URL=http://localhost:8080 \
>  NEMOCLAW_MODEL=my-model \
>  COMPATIBLE_ANTHROPIC_API_KEY=dummy \
>  nemo-deepagents onboard --non-interactive