About NVIDIA NeMo Studio

View as Markdown

Studio is still in early development. Many features are missing or should be expected to change.

NeMo Studio is the web app for AI development with NVIDIA NeMo Platform. It provides a workspace-oriented UI for managing local platform resources, reviewing agents, running agent optimization workflows, monitoring agent telemetry, and working with filesets, jobs, and secrets.

The pages visible in your workspace depend on the installed plugins, enabled services, feature flags, and NeMo Platform version. A page documented here might be hidden in your deployment. Preview pages identify the feature flag that enables them.


Getting Started

NeMo Studio is included with the platform. Follow the Setup guide to start NeMo Platform, then access Studio at /studio on your running server.

Features

Current Workspace Navigation

The current sidebar groups related pages under expandable parents. Selecting a parent that has its own landing page opens that page; use its chevron to expand the child entries.

Sidebar groupCurrent entry pointPurpose and availability
ObservabilityInsightsReview optimization insights generated from observed agent sessions. Shown when optimization is enabled; see NeMo Studio Insights.
ObservabilityTracesInspect ingested traces, spans, and session details; see NeMo Studio Traces.
ComponentsAgentsOpens the agent list. Select an agent to access Deployments, Logs, Chat, Evaluations, and Details.
ComponentsModelsOpens the base-model list directly. Expand Models for Fine-tune, Model Evaluations, Playground, and Virtual Models, when those capabilities are enabled. Fine-tune opens the Custom Models list; see NeMo Studio Custom Models. Model Evaluations opens evaluation job results; see NeMo Studio Model Evaluations.
EvaluationsExperimentsGroup evaluations for comparison, drill into results, and compare runs side by side; see NeMo Studio Experiments.
DataDatasets > Data DesignerBuild and monitor synthetic-data jobs. Other installed data plugins can appear below Datasets.
GovernanceGuardrailsManage guardrail configurations. Disabled by default; see Studio Guardrail Configs.
GovernanceIron SwarmPlugin-provided agent hardening UI. Appears only when the Iron Swarm plugin is installed; see Studio Plugin UIs.
SystemFilesetsOrganize and manage files used by agents and jobs.
SystemJobsMonitor jobs across enabled platform capabilities.

Additional entries, including Dashboard, Safe Synthesizer, Anonymizer, deployments, and workspace settings, appear when their corresponding capability or feature flag is enabled. Because plugins contribute navigation at runtime, an installed plugin can also add pages to an existing group or add a new group.

Agents

Use the Studio Agents area to review Platform-managed agents, including the current Fabric-first nemo-agents-spec-v1 experience, inspect agent details, deploy agents, open a chat session against a running deployment, and clean up deployments that are no longer needed.

For the full workflow, see Studio Agents.

Insights

Use Observability > Insights to review optimization insights the analyst agent generates from observed agent sessions and traces, and drill into an insight’s linked experiments and source traces. For a resolved or deleted insight, Run experiment shows the CLI command to start experiments for it.

For the full workflow, see Studio Insights.

Traces

Use Observability > Traces to inspect ingested telemetry in the Traces and Spans tables, and drill into a session’s trace and span detail, with specialized views for LLM, tool, agent, chain, embedding, reranker, retriever, guardrail, and evaluator spans.

For the full workflow, see Studio Traces.

Monitor

Use Agents > Monitor to inspect agent telemetry stored by the platform, including recent inference logs and token usage summaries.

For the full workflow, see Studio Monitor.

Guardrails

When the preview feature is enabled, use Governance > Guardrails to view NeMo Guardrails configurations for the current workspace. The list shows each config’s name, attached task model count, and rail count. Select a row to open the detail page, which displays the full configuration payload as formatted JSON.

Guardrail configurations are created through the nemo guardrail CLI or Guardrails API.

For the full workflow, see Studio Guardrail Configs.

Virtual Models

When the Guardrails preview feature is enabled, use Models > Virtual Models to inspect inference routes managed by the Inference Gateway. The list shows all user-created virtual models in the workspace — auto-provisioned passthrough routes are hidden. Select a row to open the details panel, which shows the default backend model when configured, and the ordered request, response, and post-response middleware pipelines attached to the route.

Virtual models are created through the nemo inference virtual-models CLI or the Inference Gateway API.

For the full workflow, see Studio Virtual Models.

Models

Select Models to browse base-model entities available in the current workspace. There is no separate Base Models child entry in the sidebar: Models is both the expandable parent and the link to the base-model list. Base models include models registered in the workspace and default platform models.

The Base Models page supports searching by model name, filtering by creation or update date, sorting alphabetically or by creation time, and showing only customizable models. Select a model card to open the model details side panel.

The model details side panel shows model metadata, parameters, and available actions. From the side panel you can open the chat playground for chat-capable models or navigate to model evaluation results.

Custom Models

Select Models > Fine-tune to open the Custom Models list, start a fine-tuning job against an eligible base model, and track job progress. Enabled by default; see NeMo Studio Custom Models.

Workspaces

Keep models and data organized in dedicated workspaces.

Filesets

Use Filesets to organize files by purpose, which determines which metadata fields are available. Purpose is chosen at creation time and can’t be changed afterward.

PurposeUse for
GenericDefault. Files that don’t fit the Dataset or Model categories. Doesn’t add purpose-specific metadata fields.
DatasetTraining and evaluation data. Enables dataset-specific metadata, including schema information. Use built-in tools to transform data schemas with LLM assistance or create train/test splits.
ModelModel weights and checkpoints. Enables model-specific metadata, including tool-calling and model configuration fields.

Supported file formats: JSON (.json), JSONL (.jsonl), CSV (.csv), and Parquet (.parquet). PDF, image, and other binary formats are not currently supported.

You can upload any file type into a fileset. However, each service supports specific input file types:

ServiceSupported File Types
Data Designer.json, .jsonl, .csv, .parquet

Safe Synthesizer

Use Data > Safe Synthesizer to create and monitor privacy-preserving synthetic tabular data jobs from NeMo Studio. The Studio page provides access to job creation, job status, details, reports, and result downloads for Safe Synthesizer workflows.

For the full workflow, see Synthesize Safe Data.

Evaluations

Studio provides separate agent, model, and workspace evaluation views:

LocationWhat it shows
Agents > select an agent > EvaluationsActive evaluation jobs, completed evaluations, and experiments scoped to the selected agent.
Models > Model EvaluationsModel evaluation job results and per-row scores. See Studio Model Evaluations.
Evaluations > ExperimentsExperiments and their evaluations across the workspace, evaluation drill-down, and side-by-side run comparison. See Studio Experiments.

Use the agent’s Evaluations tab when reviewing how a specific agent performed. Use Experiments for the broader workspace history.

Experiments

Use Evaluations > Experiments to run an evaluation against an agent from the UI — selecting the agent and judge model, uploading a dataset and evaluation config — and to compare results across runs on the experiment leaderboard.

For the full workflow, see NeMo Studio Experiments. For concepts, the data model, and the CLI and SDK workflows, see Experiments.

Jobs

Track and manage all platform jobs from a single view. The Jobs page aggregates jobs across enabled capabilities, such as Data Designer, so you can monitor progress, view logs, download artifacts, and cancel jobs in one place.

Navigate to Jobs in the workspace sidebar to see all jobs in the current workspace.

Search and filter — Find jobs by name, filter by status, or narrow results by creation or update date range.

Status tracking — Each job displays its current status:

StatusDescription
CreatedJob has been created but not yet scheduled
PendingJob is queued and waiting for resources
ActiveJob is currently running
CompletedJob finished successfully
ErrorJob encountered an error
CancelledJob was cancelled by a user
CancellingCancellation is in progress
PausedJob execution is paused
PausingJob is transitioning to paused
ResumingPaused job is restarting

Service routing — Clicking a job navigates to its service-specific detail view when one exists. Jobs from services that aren’t enabled fall back to the generic job detail view.

Cancelling a job — Active or pending jobs can be cancelled from the job list or the detail page. Cancelling a job permanently stops it and cannot be undone.

Secrets

Store API keys and credentials to securely connect with external providers. See manage-secrets for details.