Recipe & CLI Coverage Matrix

View as Markdown

This page is generated by make coverage-docs (tools/coverage) and refreshed weekly by the coverage-matrix-refresh workflow. Do not edit by hand.

It is a structural matrix: it reports which CUJs and CLI verbs are exercised by an in-repo test or demo, on what hardware class, and at what cadence. It does not report live pass/fail — that posture is a link into the AICR TestGrid (which carries aicr_version as a column facet), never embedded here.

This is a different axis from the per-recipe Coverage column in the recipe-health matrix (ADR-009 declared_coverage): that column counts declared named checks per validation phase for a single recipe, whereas this matrix answers “which journeys and CLI verbs are exercised, where, and how often.” The reverse cross-link from the recipe-health page is added by RQ1 (#1283) once that page ships. See also the CLI reference.

AICR-version axis. Scheduled UAT builds only the current checkout, so the live axis today is main. The multi-version matrix (main + the previous N stable releases) is owned by the dynamic-clusters epic (DC5); per-version posture will be a TestGrid link, not a cell here.

Legend. covered = exercised by an executable journey signal — a chainsaw/KWOK test or a wired nightly UAT runner; not-yet-covered = a shipping capability no such journey touches yet; stubbed = UAT assets exist but no scheduled workflow runs them. This tracks CUJ/CLI journey coverage — per-package Go unit-test coverage is a separate gate (make test-coverage), not reflected here.

Critical user journeys (CUJs)

ItemExercised byHardwareCadenceStatusNotes
cuj1-training-kubeflowchainsaw, uat, demoGPU (H100, real)nightlycovered
cuj2-inference-dynamodemoGPU (unwired)stubbedUAT assets present but no scheduled workflow runs them — inference UAT tracked by DC3 (#1276), Azure by DC6 (#1280)

CLI verbs

ItemExercised byHardwareCadenceStatusNotes
bundlechainsaw, uat, demoGPU (H100, real)nightlycovered
diffnot-yet-covered
evidence digestnot-yet-covered
evidence publishdemodocsnot-yet-covereddocumented in demos only; no executable test yet
evidence verifyuat, demoGPU (H100, real)nightlycovered
mirror listnot-yet-covered
querydemodocsnot-yet-covereddocumented in demos only; no executable test yet
recipechainsaw, uat, demoGPU (H100, real)nightlycovered
recipe listnot-yet-covered
recipe verify-catalognot-yet-covered
skilldemodocsnot-yet-covereddocumented in demos only; no executable test yet
snapshotchainsaw, uat, demoGPU (H100, real)nightlycovered
trust updatechainsaw, uat, demoGPU (H100, real)nightlycovered
validatechainsaw, uat, demoGPU (H100, real)nightlycovered
verifychainsaw, demosimulated / noneper-PRcovered