DGDR Reference

A DynamoGraphDeploymentRequest (DGDR) is Dynamo’s deploy-by-intent generator for DynamoGraphDeployment (DGD) resources. You describe what you want to run and your performance targets; the profiler determines a configuration and produces the DGD that serves traffic.

For the full deployment mental model — including DGD, DCD, DGDR, recipes, strategy selection, model caching, planner setup, and common pitfalls — see the Deployment Overview.

DGDR, DGD, and Recipes

Dynamo provides two Custom Resources for deploying inference graphs:

Use DGD directly when you have a hand-crafted configuration for a specific model/hardware combination. Most recipes are tuned DGD manifests. Use DGDR when you want Dynamo to generate the DGD for you.

For DGD deployment details, see Creating Deployments.

Spec Reference

Minimal Example

1
apiVersion: nvidia.com/v1beta1
2
kind: DynamoGraphDeploymentRequest
3
metadata:
4
  name: my-model
5
spec:
6
  model: Qwen/Qwen3-0.6B
7
  image: "nvcr.io/nvidia/ai-dynamo/dynamo-planner:1.1.1"  # dynamo-frontend for Dynamo < 1.1.0

Field Reference

For the complete CRD spec, see the API Reference.

Generated DGD Overrides

Use spec.overrides.dgd when the generated DynamoGraphDeployment needs a field that DGDR does not expose directly. The value is a partial nvidia.com/v1alpha1 DGD object that is merged into the profiler-generated deployment after Dynamo selects a configuration.

For example, to inject an environment variable into every generated service:

1
apiVersion: nvidia.com/v1beta1
2
kind: DynamoGraphDeploymentRequest
3
metadata:
4
  name: qwen3-sglang
5
spec:
6
  model: Qwen/Qwen3-30B-A3B
7
  backend: sglang
8
  image: "nvcr.io/nvidia/ai-dynamo/dynamo-planner:1.1.1"  # dynamo-frontend for Dynamo < 1.1.0
9
  overrides:
10
    dgd:
11
      apiVersion: nvidia.com/v1alpha1
12
      kind: DynamoGraphDeployment
13
      spec:
14
        envs:
15
          - name: TRITON_PTXAS_PATH
16
            value: /usr/local/cuda/bin/ptxas

Use spec.envs for variables that should apply to all generated services. To target a single service, override that service’s envs entry instead:

1
spec:
2
  overrides:
3
    dgd:
4
      apiVersion: nvidia.com/v1alpha1
5
      kind: DynamoGraphDeployment
6
      spec:
7
        services:
8
          decode:  # replace with the generated service name
9
            envs:
10
              - name: CUSTOM_WORKER_ENV
11
                value: "enabled"

SKU Format

When providing hardware configuration manually, use lowercase underscore format:

All supported values: gb200_sxm, b200_sxm, h200_sxm, h100_sxm, h100_pcie, a100_sxm, a100_pcie, a30, l40s, l40, l4, v100_sxm, v100_pcie, t4, mi200, mi300.

Lifecycle

When you create a DGDR, it progresses through these phases:

Conditions

The operator maintains these conditions on the DGDR status:

Monitoring

$
# Watch phase transitions
$
kubectl get dgdr my-model -n $NAMESPACE -w
$
$
# Detailed status, conditions, and events
$
kubectl describe dgdr my-model -n $NAMESPACE
$
$
# Profiling sub-phase
$
kubectl get dgdr my-model -n $NAMESPACE -o jsonpath='{.status.profilingPhase}'
$
$
# Profiling job logs
$
kubectl get pods -n $NAMESPACE -l nvidia.com/dgdr-name=my-model
$
kubectl logs -f <profiling-pod-name> -n $NAMESPACE
$
$
# View generated DGD spec (when autoApply: false)
$
kubectl get dgdr my-model -n $NAMESPACE \
>
  -o jsonpath='{.status.profilingResults.selectedConfig}' | python3 -m json.tool
$
$
# View Pareto-optimal configs from profiling
$
kubectl get dgdr my-model -n $NAMESPACE \
>
  -o jsonpath='{.status.profilingResults.pareto}'

Resource Ownership

• The DGDR does not set an owner reference on the DGD it creates. Deleting a DGDR does not delete the DGD — it persists independently so it can continue serving traffic.
• The relationship is tracked via labels: dgdr.nvidia.com/name and dgdr.nvidia.com/namespace.
• Additional resources (planner ConfigMaps) are created in the same namespace and labeled with dgdr.nvidia.com/name.

Known Issues

• pareto_analysis.py produces NaN for some configurations. Tracked as an engineering follow-up. Workaround: re-run with a narrower sweep; narrow sweeps bypass the NaN path in practice.
• PCIe profiler data not yet available. See the PCIe callout under SKU Format.

Further Reading

• Deployment Overview — DGD, DCD, DGDR, recipes, strategy selection, and common pitfalls
• Profiler Guide — Profiling algorithms, picking modes, gate checks
• Profiler Examples — Ready-to-use YAML for SLA targets, private models, MoE, overrides
• Planner Guide — Scaling modes, PlannerConfig reference
• API Reference — Complete CRD field specifications
• Creating Deployments — DGD spec for full manual control