Switch Inference Models

View as Markdown

Change the model on an existing provider route with a runtime update or a fresh sandbox recreation. The command requires both the provider and model even when the provider does not change.

Check the Current Route

Read the live route before changing it.

$nemo-deepagents inference get

Use the provider ID in the output with the new model ID.

Change the Model at Runtime

Deep Agents uses the fresh recreation path for model changes. This path keeps the OpenShell route and /sandbox/.deepagents/config.toml aligned.

$nemo-deepagents onboard --fresh --name <sandbox-name> --recreate-sandbox

To validate a new model before replacing the current sandbox, onboard it under a new name and make it the default after validation.

Account for Shared Gateways

One gateway has one live route even when NemoClaw records different intended routes for its sandboxes. Review Use Shared Gateway Routes before changing a model that another registered sandbox shares. Runtime inference set remains fail-closed when the requested change conflicts with another registered sandbox or when route metadata is incomplete.

Verify the Change

Read the route again after the switch.

$nemo-deepagents inference get

Use a sandbox-route verification when you also need to prove that the agent can reach the model.