For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
    • Overview
    • Quickstart
  • Before You Deploy
    • Infrastructure Sizing
    • Manifest
  • Deployment
    • Installation Overview
    • Image Mirroring
    • Helmfile Installation
  • GPU Cluster Setup
    • GPU Cluster Setup
    • Self-Managed Clusters
  • Configuration
    • Optional Enhancements
    • LLM Function Enablement
    • Gateway Routing
    • Third-Party Registries
    • Registry Allowlist
    • Cluster Configuration
    • KAI Scheduler
  • Using Cloud Functions
    • API
    • Service Keys
    • Function Creation
    • LLM Gateway
    • Generic HTTP Function Invocation
    • gRPC Function Invocation
    • Container Functions
    • Helm Functions
    • Streaming Functions
    • Configure Autoscaling
    • CLI
  • Function Autoscaling
    • Function Autoscaling Overview
    • Architecture
    • Operations
    • Observability
  • Observability
    • Observability
    • Example Dashboards
  • Operations
    • Control Plane Operations
    • Cluster Monitoring
    • Troubleshooting
  • Runbooks
    • Runbooks
    • Key Rotation
  • Reference
    • Cluster Reference
    • gRPC Load Testing
    • gRPC Load Test SLI Guide
    • HTTP Load Testing
    • HTTP Load Test SLI Guide
    • HTTP Soak Testing
  • Development
    • Architecture Overview
    • Fake GPU Operator
    • Release Process
  • Managed (Legacy)
    • Function Lifecycle
    • Observability
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogoCloud Functions
On this page
  • Choose an installation path
  • Overview
  • Kubernetes Cluster Requirements
  • Cluster Version
  • Required Operators and Components
  • Cluster Sizing and Storage
Deployment

Deployment

||View as Markdown|
Previous

Manifest

Next

Image Mirroring

Self-hosted NVCF installation includes the core components required for NVCF inference. Additional optional components such as caching and low latency streaming support are also available. Vanity Gateway routing is available only in stack packages that include the Vanity Gateway addon.

For a fresh install, start with the Quickstart. The quickstart uses nvcf-cli self-hosted up to install the control plane, register a GPU cluster, install NVCA, and run basic health checks.

For a full list of required artifacts, see self-hosted-artifact-manifest.

Self-hosted component overview

Want to try NVCF locally first? See Local Development to create a k3d cluster, then use the Quickstart local k3d flow.

Choose an installation path

PathUse whenStarting point
One-click CLI installationYou want the fastest fresh install and cluster registration path.Quickstart
Helmfile installationYou need manual release control, partial recovery, upgrades, or detailed Helmfile operations.Helmfile Installation
Standalone chart installationYou need GitOps integration or chart-by-chart ownership.Standalone Deployment

The control plane and GPU cluster can be the same Kubernetes cluster or separate clusters. The one-click CLI flow supports both layouts.

For remote one-click installs, prepare the Gateway API ingress path and CLI endpoint configuration before running nvcf-cli self-hosted up. See Quickstart and Gateway Routing.

Overview

Installation steps are as follows:

  1. Mirror NVCF artifacts to your registry. Follow the image mirroring instructions to pull artifacts from NGC and push them to your registry.

  2. Create or select Kubernetes cluster targets. You need a cluster for the control plane and a GPU cluster for function workloads. These can be the same cluster or separate clusters.

  3. Install the self-hosted control plane. Use the Quickstart for a one-click fresh install, Helmfile Installation for manual Helmfile operations, or Standalone Deployment for chart-by-chart installation.

  4. Register a GPU cluster and install the NVIDIA Cluster Agent. The quickstart performs this step. For manual installation paths, see Self-Managed Clusters.

  5. Install Low Latency Streaming if needed for streaming workloads. See LLS Installation.

  6. Install optional enhancements, such as caches, low latency streaming, or Vanity Gateway routing when your stack package includes that addon. See Optional Enhancements.

Kubernetes Cluster Requirements

Cluster Version

  • Any official supported Kubernetes version
  • Support for dynamic persistent volume provisioning

Required Operators and Components

NVIDIA GPU Operator

Required for GPU workload scheduling. The GPU Operator automates the management of all NVIDIA software components needed to provision GPUs in Kubernetes, including:

  • NVIDIA device drivers
  • Kubernetes device plugin for GPU discovery
  • GPU feature discovery for node labeling
  • Container runtime integration (containerd, CRI-O, or Docker)
  • Monitoring and telemetry tools

See NVIDIA GPU Operator documentation for installation instructions.

Fake GPU Operator for Development/Testing:

For environments without actual GPU hardware, install the fake GPU operator to simulate GPU resources. See fake-gpu-operator for full instructions.

Network Policies

Your cluster must support Kubernetes Network Policies if network isolation is required.

Persistent Storage

A StorageClass must be configured for persistent volumes. Common options:

  • Amazon EKS: gp3 (default)
  • Local development: local-path
  • Other platforms: Any CSI-compatible storage class

Some cloud providers have minimum PVC size requirements. For example, AWS EBS gp3 volumes have a 1Gi minimum.

Cluster Sizing and Storage

See infrastructure-sizing for node pool specifications, storage recommendations, and three recommended sizing tiers (Development, Minimal HA, and Production).

Self-hosted minimum topology