> This page is for AI Cluster Runtime, version v1.3.0.
> For other versions, use one of these documentation indexes:
> - Latest · v1.3.0 (default): https://docs.nvidia.com/aicr/latest/llms.txt
> - v1.3.0: https://docs.nvidia.com/aicr/v1.3.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/aicr/llms.txt.

\{/*
Copyright (c) 2026, NVIDIA CORPORATION.  All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0
*/\}

# Recipe Health

This page reports the **structural health** of every recipe AICR can resolve — one row per leaf criteria combination (service × accelerator × OS × intent × platform), plus any non-leaf coordinate retained because it carries published dashboard evidence (a plain coordinate that gained a platform sibling keeps its row so its Evidence link is never silently dropped). It answers *"across the whole matrix, what is the current structural state of each recipe?"* and is the catalog-wide complement to per-recipe [conformance evidence](https://github.com/NVIDIA/aicr/blob/main/docs/design/007-recipe-evidence.md). For a family carrying an ADR-015 configuration profile (`gpuStack` on AKS, GKE, OKE, and CKS), the row grades the composition resolved at the **declaration default** (`azure-managed` on AKS, `gke-default` on GKE, `oci-managed` on OKE, `coreweave` on CKS); per-profile-value rows are a follow-up.

The matrix is computed **hermetically and offline**: every signal is a pure read of the resolved recipe — no Helm render, no GPU, no cluster, no network. It is regenerated from the recipe catalog by `make recipe-health-docs` and is kept current by a weekly bot PR. `make recipe-health-check` is an advisory staleness check (it is **not** wired into `make qualify` or the merge gate). The full design is recorded in [ADR-009](https://github.com/NVIDIA/aicr/blob/main/docs/design/009-recipe-health-tracking.md).

## What the columns mean

**Status** is the rolled-up structural verdict per recipe:

- `pass` — the recipe is structurally sound.
- `warn` — a non-fatal structural concern was surfaced.
- `fail` — a graded structural signal failed (e.g. the recipe does not resolve).
- `unknown` — a transient resolver error (a re-runnable timeout) prevented a confident verdict; the recipe is held rather than penalized. `unknown` is never silently read as `pass`.

> **Structural soundness is not a validation verdict.** A recipe that resolves cleanly is *structurally sound*, **not** *validated and performant*. Runtime/validation claims come only from signed conformance evidence, which is out of scope for this matrix today (see the Evidence and Signer class columns below).

**chart_pinned (folded into Status).** One of the graded signals behind `Status` checks that every resolved Helm component references an explicit chart version, per [ADR-006](https://github.com/NVIDIA/aicr/blob/main/docs/design/006-image-pinning-policy.md). This is **layer 1 only** — the chart-version pin — *not* image-digest pinning, and it is a render-free read of the resolved recipe (it does not pull or template the chart).

**Coverage** is a descriptor — it is *never* graded, so a deliberately minimal recipe is never penalized for declaring fewer checks. It is a compact per-phase summary of the **declared** validation checks, in the form `R:n D:n P:n C:n` — the count of named checks declared for the readiness, deployment, performance, and conformance phases respectively.

**Evidence** deep-links each recipe that has a live dashboard presence to its coordinate on the AICR evidence dashboard at [validation.aicr.run](https://validation.aicr.run) (`/#/<group>/<dashboard>/<tab>`, where `group` is the service, `dashboard` is `<accelerator>-<os>`, and `tab` is `<intent>[-<platform>]`). A recipe without a committed presence entry stays a literal `pending` — the column reports the absence of a **committed linkable presence**, not necessarily the absence of live evidence (profiled families' entries are deliberately withheld until profile-aware links land, so their rows read `pending` even when the dashboard holds per-value evidence). Today the dashboard covers only the UAT-driven coordinates, so most rows are `pending` until real-hardware coverage broadens; this matrix does not gate on that.

The link is constructed **hermetically and deterministically** from the recipe's resolved criteria using the shared `pkg/recipe.CoordinateFor` mapping — the generator makes no network call, and the coordinate carries **no Kubernetes version**, so a link is stable across k8s-version rolls. The Evidence cell is a link and nothing more: it points at the live board and carries **no** pass/fail state or count. Which recipes are linked is driven by a committed presence manifest (`pkg/testgrid/presence.yaml`); a weekly, warning-only bot keeps it honest by reporting any link that no longer resolves against the live dashboard data (it never blocks merges or edits this doc).

> **Community-source posture is author-asserted provenance, not independently-verified correctness.** A coordinate's tab placement and any community-sourced results on the dashboard are declared by the signing author; corroboration counts agreement at the same AICR version but does not itself certify runtime correctness. Read the linked board accordingly.

> **`aicr recipe --require-evidence` follows committed pointers, not this column.** The flag, `AICR_REQUIRE_EVIDENCE`, and `spec.recipe.requireEvidence` reject a resolved recipe that has no pointer committed under `recipes/evidence/` in the binary. `aicr query --require-evidence` uses the same check. That is a different signal from the Evidence column, which reports dashboard presence from `pkg/testgrid/presence.yaml`. The Signer class column reads the same committed pointers the flag checks. The flag checks presence only. It does not verify a signature or contact a registry, and a pointer on a base id does not cover a profiled resolve. A resolve that uses `--data` fails, even when the leaf overlay is still the embedded recipe, because the pointer attests the embedded catalog.

The deep-link is the current Evidence rendering. It is distinct from, and coexists with, [ADR-009](https://github.com/NVIDIA/aicr/blob/main/docs/design/009-recipe-health-tracking.md)'s deferred, verify-gated *in-cell freshness* state (`unattested` vs aged, derived from a signed attestation's `AttestedAt`). The link points at the live board, and an optional freshness token can later annotate the same cell without replacing the link. The signer class has its own column, so the Evidence cell stays free for that token. See also the [coverage matrix](/aicr/v1.3.0/user-guide/coverage-matrix) for the complementary breadth view.

**Signer class** names who signed each recipe's committed evidence pointers under `recipes/evidence/<recipe>/<src>/`. The class is the one [`recipes/evidence/allowlist.yaml`](https://github.com/NVIDIA/aicr/blob/main/recipes/evidence/allowlist.yaml) assigns to that source slug:

- `first-party` is the project's own UAT workflows.
- `community` is individual external contributors.
- `partner` is vetted partner organizations.

Reading the column:

- An em dash means the recipe has no committed pointer. First-party UAT workflows ingest evidence directly and commit no pointer, so an em dash does not mean the evidence is first-party.
- A recipe with pointers from more than one class lists each, as in `community, partner`.
- A profiled row reads the pointer for its declaration-default value (`<recipe>-gpustack-<value>`), the same id `--require-evidence` checks, not the unprofiled id.
- The column reads committed pointers, not dashboard presence, so a recipe can carry a signer class while its Evidence reads `pending`.

Today every committed pointer is `community`, published from a contributor fork per [evidence publishing](https://github.com/NVIDIA/aicr/blob/main/docs/contributor/evidence-publishing.md) and admitted by maintainer review.

\{/* BEGIN AICR-HEALTH */\}
## Summary

- Recipes: **81**
- Pass: **81** · Warn: **0** · Fail: **0** · Unknown: **0**

## Recipes

| Recipe | Service | Accelerator | OS | Intent | Platform | Status | Coverage | Evidence | Signer class |
|--------|---------|-------------|----|--------|----------|--------|----------|----------|--------------|
| a100-any | — | a100 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| b200-any | — | b200 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| gb200-any | — | gb200 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| gb300-any | — | gb300 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| h100-any | — | h100 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| h200-any | — | h200 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| l40-any | — | l40 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| l40s-any | — | l40s | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| rtx-pro-6000-any | — | rtx-pro-6000 | — | — | — | pass | R:0 D:4 P:0 C:0 | pending | — |
| monitoring-hpa | — | — | — | — | — | pass | R:0 D:0 P:0 C:0 | pending | — |
| aks-ubuntu | aks | — | ubuntu | — | — | pass | R:0 D:0 P:0 C:5 | pending | — |
| a100-aks-ubuntu-training-kubeflow | aks | a100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| h100-aks-ubuntu-inference-dynamo | aks | h100 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | pending | community |
| h100-aks-ubuntu-training-kubeflow | aks | h100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:1 C:11 | pending | community |
| h100-aks-ubuntu-training-slurm | aks | h100 | ubuntu | training | slurm | pass | R:0 D:4 P:0 C:12 | pending | — |
| bcm-inference | bcm | — | — | inference | — | pass | R:0 D:0 P:0 C:5 | pending | — |
| h100-bcm-ubuntu-training-kubeflow | bcm | h100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:6 | pending | — |
| h100-cks-ubuntu-training | cks | h100 | ubuntu | training | — | pass | R:0 D:2 P:0 C:1 | pending | — |
| rtx-pro-6000-cks-ubuntu-training | cks | rtx-pro-6000 | ubuntu | training | — | pass | R:0 D:2 P:0 C:1 | pending | — |
| eks-ubuntu | eks | — | ubuntu | — | — | pass | R:0 D:0 P:0 C:5 | pending | — |
| a100-eks-ubuntu-training-kubeflow | eks | a100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| gb200-eks-amazonlinux-inference | eks | gb200 | amazonlinux | inference | — | pass | R:0 D:4 P:0 C:5 | pending | — |
| gb200-eks-ubuntu-inference-dynamo | eks | gb200 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | [eks/gb200-ubuntu/inference-dynamo](https://validation.aicr.run/#/eks/gb200-ubuntu/inference-dynamo) | — |
| gb200-eks-ubuntu-training-kubeflow | eks | gb200 | ubuntu | training | kubeflow | pass | R:0 D:4 P:2 C:11 | [eks/gb200-ubuntu/training-kubeflow](https://validation.aicr.run/#/eks/gb200-ubuntu/training-kubeflow) | — |
| gb200-eks-ubuntu-training-slurm | eks | gb200 | ubuntu | training | slurm | pass | R:0 D:4 P:0 C:13 | pending | — |
| gb300-eks-amazonlinux-inference | eks | gb300 | amazonlinux | inference | — | pass | R:0 D:4 P:0 C:5 | pending | — |
| gb300-eks-ubuntu-inference-dynamo | eks | gb300 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | [eks/gb300-ubuntu/inference-dynamo](https://validation.aicr.run/#/eks/gb300-ubuntu/inference-dynamo) | community |
| gb300-eks-ubuntu-training-kubeflow | eks | gb300 | ubuntu | training | kubeflow | pass | R:0 D:4 P:2 C:11 | [eks/gb300-ubuntu/training-kubeflow](https://validation.aicr.run/#/eks/gb300-ubuntu/training-kubeflow) | community |
| gb300-eks-ubuntu-training-slurm | eks | gb300 | ubuntu | training | slurm | pass | R:0 D:4 P:0 C:13 | pending | — |
| h100-eks-amazonlinux-inference | eks | h100 | amazonlinux | inference | — | pass | R:0 D:4 P:0 C:5 | pending | — |
| h100-eks-ubuntu-inference-dynamo | eks | h100 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | [eks/h100-ubuntu/inference-dynamo](https://validation.aicr.run/#/eks/h100-ubuntu/inference-dynamo) | — |
| h100-eks-ubuntu-inference-nim | eks | h100 | ubuntu | inference | nim | pass | R:0 D:4 P:0 C:12 | pending | — |
| h100-eks-ubuntu-training-kubeflow | eks | h100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:1 C:11 | [eks/h100-ubuntu/training-kubeflow](https://validation.aicr.run/#/eks/h100-ubuntu/training-kubeflow) | — |
| h100-eks-ubuntu-training-kueue | eks | h100 | ubuntu | training | kueue | pass | R:0 D:4 P:1 C:10 | pending | — |
| h100-eks-ubuntu-training-runai | eks | h100 | ubuntu | training | runai | pass | R:0 D:4 P:1 C:10 | pending | — |
| h100-eks-ubuntu-training-slurm | eks | h100 | ubuntu | training | slurm | pass | R:0 D:4 P:0 C:12 | pending | — |
| h200-eks-inference | eks | h200 | — | inference | — | pass | R:0 D:4 P:0 C:5 | pending | — |
| h200-eks-training-kubeflow | eks | h200 | — | training | kubeflow | pass | R:0 D:4 P:1 C:11 | pending | — |
| rtx-pro-6000-eks-amazonlinux-inference | eks | rtx-pro-6000 | amazonlinux | inference | — | pass | R:0 D:4 P:0 C:10 | pending | — |
| rtx-pro-6000-eks-ubuntu-inference-dynamo | eks | rtx-pro-6000 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | pending | community |
| rtx-pro-6000-eks-ubuntu-inference-nim | eks | rtx-pro-6000 | ubuntu | inference | nim | pass | R:0 D:4 P:0 C:12 | pending | — |
| rtx-pro-6000-eks-ubuntu-training-kubeflow | eks | rtx-pro-6000 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| gb300-generic-ubuntu-training | generic | gb300 | ubuntu | training | — | pass | R:0 D:4 P:1 C:5 | pending | community |
| a100-gke-cos-training-kubeflow | gke | a100 | cos | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| b200-gke-cos-inference-dynamo | gke | b200 | cos | inference | dynamo | pass | R:0 D:4 P:0 C:12 | pending | — |
| b200-gke-cos-training-kubeflow | gke | b200 | cos | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| gb200-gke-cos-inference-dynamo | gke | gb200 | cos | inference | dynamo | pass | R:0 D:4 P:1 C:12 | pending | — |
| gb200-gke-cos-training-kubeflow | gke | gb200 | cos | training | kubeflow | pass | R:0 D:4 P:1 C:11 | pending | — |
| gb200-gke-cos-training-slurm | gke | gb200 | cos | training | slurm | pass | R:0 D:4 P:0 C:13 | pending | — |
| gb300-gke-cos-inference-dynamo | gke | gb300 | cos | inference | dynamo | pass | R:0 D:4 P:0 C:12 | pending | — |
| gb300-gke-cos-training-kubeflow | gke | gb300 | cos | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| h100-gke-cos-inference-dynamo | gke | h100 | cos | inference | dynamo | pass | R:0 D:4 P:1 C:12 | pending | — |
| h100-gke-cos-training-kubeflow | gke | h100 | cos | training | kubeflow | pass | R:0 D:6 P:1 C:11 | pending | community |
| h100-gke-cos-training-kueue | gke | h100 | cos | training | kueue | pass | R:0 D:6 P:1 C:10 | pending | — |
| h100-gke-cos-training-runai | gke | h100 | cos | training | runai | pass | R:0 D:6 P:1 C:10 | pending | — |
| h100-gke-cos-training-slurm | gke | h100 | cos | training | slurm | pass | R:0 D:6 P:0 C:12 | pending | — |
| h200-k0s-ubuntu-training | k0s | h200 | ubuntu | training | — | pass | R:0 D:4 P:0 C:4 | [k0s/h200-ubuntu/training](https://validation.aicr.run/#/k0s/h200-ubuntu/training) | community |
| h100-kind-inference-dynamo | kind | h100 | — | inference | dynamo | pass | R:0 D:4 P:0 C:11 | pending | — |
| h100-kind-training-kubeflow | kind | h100 | — | training | kubeflow | pass | R:0 D:4 P:0 C:10 | pending | — |
| h100-kind-training-kueue | kind | h100 | — | training | kueue | pass | R:0 D:4 P:0 C:9 | pending | — |
| h100-kind-training-slurm | kind | h100 | — | training | slurm | pass | R:0 D:4 P:0 C:10 | pending | — |
| rtx-pro-6000-lke-ubuntu-inference | lke | rtx-pro-6000 | ubuntu | inference | — | pass | R:0 D:4 P:0 C:10 | pending | — |
| rtx-pro-6000-lke-ubuntu-training-kubeflow | lke | rtx-pro-6000 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| b300-mk8s-ubuntu-inference-dynamo | mk8s | b300 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:3 | pending | community |
| gb200-nvke-ubuntu-training-kubeflow | nvke | gb200 | ubuntu | training | kubeflow | pass | R:0 D:4 P:2 C:6 | pending | community |
| gb300-nvke-ubuntu-inference-dynamo | nvke | gb300 | ubuntu | inference | dynamo | pass | R:0 D:4 P:0 C:11 | pending | community |
| gb300-nvke-ubuntu-training-kubeflow | nvke | gb300 | ubuntu | training | kubeflow | pass | R:0 D:4 P:1 C:6 | pending | community |
| vr200-nvke-ubuntu-inference-dynamo | nvke | vr200 | ubuntu | inference | dynamo | pass | R:0 D:4 P:0 C:10 | pending | community |
| vr200-nvke-ubuntu-training-kubeflow | nvke | vr200 | ubuntu | training | kubeflow | pass | R:0 D:4 P:2 C:5 | pending | community |
| ocp-inference-nim | ocp | — | — | inference | nim | pass | R:0 D:3 P:0 C:12 | pending | — |
| ocp-training | ocp | — | — | training | — | pass | R:0 D:3 P:0 C:1 | pending | — |
| a100-oke-ubuntu-training-kubeflow | oke | a100 | ubuntu | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| gb200-oke-ubuntu-inference-dynamo | oke | gb200 | ubuntu | inference | dynamo | pass | R:0 D:4 P:1 C:12 | pending | — |
| gb200-oke-ubuntu-training-kubeflow | oke | gb200 | ubuntu | training | kubeflow | pass | R:0 D:4 P:2 C:11 | pending | — |
| gb300-oke-ubuntu-training | oke | gb300 | ubuntu | training | — | pass | R:0 D:4 P:2 C:9 | pending | community |
| l40s-oke-inference | oke | l40s | ol | inference | — | pass | R:0 D:4 P:0 C:10 | pending | — |
| l40s-oke-training-kubeflow | oke | l40s | ol | training | kubeflow | pass | R:0 D:4 P:0 C:11 | pending | — |
| rke2-sles | rke2 | — | sles | — | — | pass | R:0 D:0 P:0 C:4 | pending | — |
| vr200-rke2-ubuntu-inference-dynamo | rke2 | vr200 | ubuntu | inference | dynamo | pass | R:0 D:4 P:0 C:11 | [rke2/vr200-ubuntu/inference-dynamo](https://validation.aicr.run/#/rke2/vr200-ubuntu/inference-dynamo) | community |
| vr200-rke2-ubuntu-training | rke2 | vr200 | ubuntu | training | — | pass | R:0 D:4 P:1 C:9 | [rke2/vr200-ubuntu/training](https://validation.aicr.run/#/rke2/vr200-ubuntu/training) | community |
| vr200-rke2-ubuntu-training-kubeflow | rke2 | vr200 | ubuntu | training | kubeflow | pass | R:0 D:4 P:1 C:10 | [rke2/vr200-ubuntu/training-kubeflow](https://validation.aicr.run/#/rke2/vr200-ubuntu/training-kubeflow) | community |

\{/* END AICR-HEALTH */\}