KAI Scheduler Integration Guide
KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale. To use the KAI Scheduler for NVCF Workloads the following configuration should be applied post the installation of the KAI Scheduler in the cluster and the Optimized AI Workload Scheduling enabled on the cluster. NVCF Workloads deployed will be automatically BinPacked upon this cluster configuration changes.
KAI Scheduler Installation
Upgrade to latest KAI Scheduler release is recommended to get latest fixes and security patches
NVCA’s KAI scheduler integration expects default queues to exist with names default-parent-queue (parent) and default-queue (child);
other queues may exist in the cluster.
One caveat is that NVCA expects all queues used to create NVCF workloads to have unlimited (-1) quotas and limits
to ensure full cluster capacity utilization and accurate usage tracking. If the cluster is partitioned to serve both NVCF and non-NVCF workloads
and KAI scheduler queue quotas/limits are limited to reflect this, then Shared Cluster mode must be enabled so non-NVCF workload nodes
are accurately excluded from tracking and scheduling by NVCA.
Create values.yaml with default queue attributes:
