> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/run-ai/_mcp/server.

# Distributed

Distributed Training, is the ability to split the training of a model among multiple processors. 
It is often a necessity when multi-GPU training no longer applies; 
typically when you require more GPUs than exist on a single node. 
Each such split is a pod (see definition above). NVIDIA Run:ai spawns an additional launcher process that manages and 
coordinates the other worker pods. For more information, see [Distributed training](/run-ai/self-hosted/documentation/workloads-in-nvidia-run-ai/using-training/distributed-training-models).


## API Docs

- Distributed [Create a distributed training.](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/create-distributed.md)
- Distributed [Get distributed training's data. [Experimental]](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/get-distributed.md)
- Distributed [Delete a distributed training by id.](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/delete-distributed.md)
- Distributed [Suspend a distributed training.](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/suspend-distributed.md)
- Distributed [Resume a distributed training.](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/resume-distributed.md)

## OpenAPI Specification

The raw OpenAPI 3.1 specification for this API is available at:
- [OpenAPI JSON](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/openapi.json)
- [OpenAPI YAML](https://docs.nvidia.com/run-ai/self-hosted/v3.0/reference/rest-api/endpoints/workloads/distributed/openapi.yaml)