v0.3.0

View as Markdown

NeMo Platform v0.3.0 expands the OSS distribution beyond local setup with self-managed Kubernetes and Helm documentation, while continuing to support the local-first Python package, CLI, SDK, Studio, and plugin workflows.

Highlights

  • Self-managed Kubernetes. The docs now cover Helm-based deployment to user-managed Kubernetes clusters, including local Kind workflows and cluster prerequisites.
  • Agent deployment docs. Agent container deployment guidance covers local and Kubernetes paths and clarifies how SDK, CLI, and REST callers resolve default model placeholders.
  • Versioned compatibility. Requirements and support-matrix pages describe the 0.3.0 release instead of the previous local-only scope.
  • Generated reference docs. The configuration reference remains generated from platform config models and renders as regular Fern MDX.

What’s included

Platform

  • Local source-install workflows with make bootstrap, nemo setup, and nemo services run.
  • Self-managed Helm/Kubernetes documentation for users deploying the platform outside the local developer process.
  • Source-install auth and OIDC bootstrap guidance for users who enable RBAC locally.

Agents

  • NAT-based agent workflow support through nemo agents.
  • Agent container rendering, building, publishing, and deployment guidance.
  • SDK and CLI examples that use the configured default model for agent registration.

Models and Inference

  • Inference Gateway support for provider registration, virtual models, and OpenAI-compatible routing.
  • Local and provider-backed model workflows for CLI, SDK, Studio, and agents.

Plugins

  • First-party plugin workflows continue from the previous release line, including Agents, Customizer, Safe Synthesizer, Auditor, Guardrails, Evaluator, Anonymizer, Data Designer, Switchyard middleware, and Deployments.
  • Plugin docs cover runtime service, CLI, job, controller, inference middleware, and coding-agent skill surfaces.

Install

For a fresh local checkout:

$git clone https://github.com/NVIDIA-NeMo/nemo-platform.git
$cd nemo-platform
$make bootstrap
$source .venv/bin/activate
$nemo setup

See Setup for prerequisites and provider configuration.

For self-managed Kubernetes, start with Install NeMo Platform Helm Chart.

Upgrade from v0.2.x

From an existing local checkout:

$git fetch
$git checkout main
$make bootstrap
$source .venv/bin/activate
$nemo setup

After setup, restart local services before using CLI, SDK, Studio, or plugin workflows against the upgraded checkout.

Compatibility

  • Python 3.12-3.13
  • macOS and Linux for local CLI, SDK, Studio, and hosted-provider workflows
  • Linux x86_64 for local NVIDIA GPU workloads
  • Self-managed Kubernetes clusters deployed with Helm
  • Docker for Docker-backed platform, job, and local model-serving workflows
  • NVIDIA GPU access for local training, model serving, and GPU-backed synthetic data workflows
  • Node 22.18.0+ for Studio assets
  • Platform API and nemo-platform Python SDK 0.3.0

Current constraints

  • Self-managed scope. v0.3.0 documents local setup and user-managed Kubernetes deployment. It is not a managed hosted-service release.
  • Docker model serving. v0.3.0 includes vLLM deployment in Docker. Docker deployment for NIM is not included in this release.
  • Customizer Docker support. Docker-backed Customizer jobs target GPU Linux environments. ARM64 images and NeMo Automodel Docker execution are not part of this release.
  • Auth and RBAC. Source-install auth and OIDC setups require the bootstrap IAM seed step described in Setup. Validate role bindings for your deployment mode before relying on them for multi-user access control.
  • Skill Evaluation. Skill Evaluation workflows are not included in v0.3.0.