> This page is for Self-Hosted, version v3.0 (default).
> For other versions, use one of these documentation indexes:
> - v3.0 (default): https://docs.nvidia.com/run-ai/self-hosted/v3.0/llms.txt
> - v2.26: https://docs.nvidia.com/run-ai/self-hosted/v2.26/llms.txt
> - v2.25: https://docs.nvidia.com/run-ai/self-hosted/v2.25/llms.txt
> - v2.24: https://docs.nvidia.com/run-ai/self-hosted/v2.24/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/run-ai/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/run-ai/_mcp/server.

# runai inference distributed

Runs multiple coordinated inference processes across multiple nodes. Required for models too large to run on a single node.

### Options

```
  -h, --help   help for distributed
```

### Options inherited from parent commands

```
      --config-file string   config file name; can be set by environment variable RUNAI_CLI_CONFIG_FILE (default "config.json")
      --config-path string   config path; can be set by environment variable RUNAI_CLI_CONFIG_PATH
  -d, --debug                enable debug mode
  -q, --quiet                enable quiet mode, suppress all output except error messages
      --verbose              enable verbose mode
```

### SEE ALSO

* [runai inference](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference)	 - inference management
* [runai inference distributed bash](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-bash)	 - open a bash shell in a distributed inference workload
* [runai inference distributed delete](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-delete)	 - delete a distributed inference workload
* [runai inference distributed describe](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-describe)	 - describe a distributed inference workload
* [runai inference distributed exec](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-exec)	 - execute a command in a distributed inference workload
* [runai inference distributed list](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-list)	 - list distributed inference workloads
* [runai inference distributed logs](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-logs)	 - view logs of a distributed inference workload
* [runai inference distributed port-forward](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-port-forward)	 - forward one or more local ports to a distributed inference workload
* [runai inference distributed scale](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-scale)	 - scale a distributed inference workload
* [runai inference distributed submit](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-distributed-submit)	 - submit a distributed inference workload