> This page is for Self-Hosted, version v3.0 (default).
> For other versions, use one of these documentation indexes:
> - v3.0 (default): https://docs.nvidia.com/run-ai/self-hosted/v3.0/llms.txt
> - v2.26: https://docs.nvidia.com/run-ai/self-hosted/v2.26/llms.txt
> - v2.25: https://docs.nvidia.com/run-ai/self-hosted/v2.25/llms.txt
> - v2.24: https://docs.nvidia.com/run-ai/self-hosted/v2.24/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/run-ai/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/run-ai/_mcp/server.

# runai inference nim

[Experimental] Runs NVIDIA NIM (NVIDIA Inference Microservices) workloads. Optimized for deploying foundation models.

### Options

```
  -h, --help   help for nim
```

### Options inherited from parent commands

```
      --config-file string   config file name; can be set by environment variable RUNAI_CLI_CONFIG_FILE (default "config.json")
      --config-path string   config path; can be set by environment variable RUNAI_CLI_CONFIG_PATH
  -d, --debug                enable debug mode
  -q, --quiet                enable quiet mode, suppress all output except error messages
      --verbose              enable verbose mode
```

### SEE ALSO

* [runai inference](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference)	 - inference management
* [runai inference nim bash](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-bash)	 - open a bash shell in a nim inference workload
* [runai inference nim delete](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-delete)	 - delete a nim inference workload
* [runai inference nim describe](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-describe)	 - describe a nim inference workload
* [runai inference nim exec](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-exec)	 - execute a command in a nim inference workload
* [runai inference nim list](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-list)	 - list nim inference workloads
* [runai inference nim logs](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-logs)	 - view logs of a nim inference workload
* [runai inference nim port-forward](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-port-forward)	 - forward one or more local ports to a nim inference workload
* [runai inference nim scale](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-scale)	 - scale a nim inference workload
* [runai inference nim submit](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-submit)	 - submit a nim inference workload
* [runai inference nim update](/run-ai/self-hosted/reference/cli/runai/inference/runai-inference-nim-update)	 - update a nim inference workload