Deployment Tiers#

What changes between tiers:

  • Identity scope — direct SSO → per-tier role mapping.

  • Operations model — self-service per workspace → fleet-managed by a dedicated platform team.

  • Audit centralization — per-workspace → centralized OCSF / SIEM.

  • Cost telemetry and budget controls — per-workspace meter → centralized FinOps integration with budget gates.

The pattern is the same across all five tiers; the difference is operational scale.

Inference is routed by default — to an approved internal or external model endpoint — and is independent of the tier’s compute shape; GPU acceleration and inference are separate choices. Agentic coding with frontier models runs on routed inference at any tier, including CPU VM. On-device GPU inference is the exception: smaller models that fit the device, or sensitive / sovereign context where data cannot leave the host. The GPU tiers provide acceleration for tools and local model options, not a requirement for agentic coding.

Table 8: Deployment Tiers

Tier

Target Use

Typical Shape

Notes

CPU VM

Starter POC; agentic coding, documentation, and low-intensity workflows on routed inference

Managed VM

Good first step for proving access, identity, connectors and audit; sufficient for most agentic coding

GPU VM or workstation

GPU-accelerated tools and test loops; local experimentation with models that fit a single GPU (frontier-model coding still uses routed inference)

Managed VM or workstation with GPU

Good for teams standardizing agent workflows that need local acceleration; inference routed by default

Deskside accelerated workstation

Power users and researchers; local inference of models that fit the device; sensitive / sovereign context where data cannot leave

DGX Spark, DGX Station, RTX PRO workstation

Fits long-running agent loops and local model options

Team shared system

Multiple users, each in a separate per-user environment on shared hardware; larger models, shared datasets, heavier test workloads

Shared DGX, HGX, or RTX PRO Server

Shared capacity hosting separate per-user VMs / micro-VMs — not a shared workspace; requires stronger scheduling, tenancy and data controls

Platform fleet

Broad enterprise rollout

Managed fleet with package channels, policy distribution, telemetry, SIEM

Requires signed releases, rollback, support ownership and incident process

Device sanitization between users. GPUs and other stateful devices (VRAM, caches, scratch storage, NVMe local SSD) must be wiped between users — per-workspace reprovisioning is the basic mechanism.