This page is for Self-Hosted, version v3.0 (default).
For other versions, use one of these documentation indexes:
- v3.0 (default): https://docs.nvidia.com/run-ai/self-hosted/v3.0/llms.txt
- v2.26: https://docs.nvidia.com/run-ai/self-hosted/v2.26/llms.txt
- v2.25: https://docs.nvidia.com/run-ai/self-hosted/v2.25/llms.txt
- v2.24: https://docs.nvidia.com/run-ai/self-hosted/v2.24/llms.txt
submit a workload from a yaml file
Synopsis
Submit a workload using a Kubernetes manifest file.
This command submits workloads directly from YAML manifests to the control plane. It provides flexibility in managing workloads through declarative configuration.
runai workload submit [NAME] [flags]
Examples
# Submit a workload from a manifest file (uses manifest metadata.name or defaults to "workload")runai workload submit --file workload.yaml --project my-project# Submit with a specific namerunai workload submit <name> --file workload.yaml --project my-project# Submit with name as prefix (generates random suffix)runai workload submit --name-prefix my-workload --file workload.yaml --project my-project# Submit with priority overriderunai workload submit --file workload.yaml --project my-project --priority high# Submit with categoryrunai workload submit --file workload.yaml --project my-project --category production# Submit with MNNVL mode enabledrunai workload submit --file workload.yaml --project my-project --mnnvl Required
Options
--category string Set workload category-f, --file string Path to the workload manifest YAML file (required)-h, --help help for submit--mnnvl mnnvl Enable MNNVL (Multi-Node NVLink) mode. Valid values: Required|None--name-prefix string Use the provided name as a prefix (generates random suffix). Mutually exclusive with [NAME] argument--preemptibility preemptibility Specify whether the workload can be preempted by higher-priority workloads. Valid values: preemptible, non-preemptible. Overrides the default preemptibility for the workload type.--priority string Sets the workload’s scheduling priority. Valid values: very-low, low, medium-low, medium, medium-high, high, very-high.Overrides the default priority for the workload type. Changing priority does not update preemptibility automatically.-p, --project string Specify the project for the command to use. Defaults to the project set in the context, if any. Use 'runai project set <project>' to set the default.
Options inherited from parent commands
--config-file string config file name; can be set by environment variable RUNAI_CLI_CONFIG_FILE (default "config.json")--config-path string config path; can be set by environment variable RUNAI_CLI_CONFIG_PATH-d, --debug enable debug mode-q, --quiet enable quiet mode, suppress all output except error messages--verbose enable verbose mode
SEE ALSO
- runai workload - workload management