Skip to navigation

How to Deploy NVIDIA NIM Inference

View as Markdown

NVIDIA NIM Inference

Learn how to deploy NVIDIA NIM inference services using NVIDIA Run:ai.

Note

This video was recorded using NVIDIA Run:ai version 2.24.18. The user interface, features, and workflows may differ in newer releases. For the latest information, refer to the current documentation.

What You’ll Learn:

  • Deploy NVIDIA NIM inference services on the Run:ai platform
  • Launch scalable AI inference endpoints
  • Request GPU resources for inference workloads
  • Manage NIM-based model serving
  • Support production-ready inference workflows with NVIDIA Run:ai