Switch Inference Models

View as Markdown

Change the model on an existing provider route with a runtime update or a fresh sandbox recreation. The command requires both the provider and model even when the provider does not change.

Check the Current Route

Read the live route before changing it.

$nemo-deepagents inference get

Use the provider ID in the output with the new model ID.

Change the Model at Runtime

Deep Agents uses the fresh recreation path for model changes. This path keeps the OpenShell route and /sandbox/.deepagents/config.toml aligned.

$nemo-deepagents onboard --fresh --name <sandbox-name> --recreate-sandbox

To validate a new model before replacing the current sandbox, onboard it under a new name and make it the default after validation.

Account for Shared Gateways

OpenShell exposes one inference route per gateway. Every registered sandbox on the same gateway, including stopped sandboxes, must record the same provider and model. NemoClaw exits before changing state when the requested model conflicts with another sandbox on the gateway.

Align the sandboxes to one route, remove a sandbox you no longer need, or onboard a sandbox with another NEMOCLAW_GATEWAY_PORT.

Verify the Change

Read the route again after the switch.

$nemo-deepagents inference get

Use a sandbox-route verification when you also need to prove that the agent can reach the model.