runai inference nim

[Experimental] Runs NVIDIA NIM (NVIDIA Inference Microservices) workloads. Optimized for deploying foundation models.

Options

  -h, --help   help for nim

Options inherited from parent commands

      --config-file string   config file name; can be set by environment variable RUNAI_CLI_CONFIG_FILE (default "config.json")
      --config-path string   config path; can be set by environment variable RUNAI_CLI_CONFIG_PATH
  -d, --debug                enable debug mode
  -q, --quiet                enable quiet mode, suppress all output except error messages
      --verbose              enable verbose mode

SEE ALSO

• runai inference - inference management
• runai inference nim bash - open a bash shell in a nim inference workload
• runai inference nim delete - delete a nim inference workload
• runai inference nim describe - describe a nim inference workload
• runai inference nim exec - execute a command in a nim inference workload
• runai inference nim list - list nim inference workloads
• runai inference nim logs - view logs of a nim inference workload
• runai inference nim port-forward - forward one or more local ports to a nim inference workload
• runai inference nim scale - scale a nim inference workload
• runai inference nim submit - submit a nim inference workload
• runai inference nim update - update a nim inference workload