Hermes Agent Quick Start
Goal
Run one Hermes Agent turn and write its session, model, and tool lifecycle to a local Agent Trajectory Observability Format (ATOF) file.
Use a Hermes Agent installation with native NeMo Relay integration on a platform
with a supported Relay native wheel. Do not install the former Hermes Agent Relay
observability plugin or launch Hermes Agent through the nemo-relay CLI.
This quick start configures local Relay event export. Hermes Agent shared-metrics collection and transmission to Nous have separate consent controls.
Use the event relationships to follow model and tool work through a run and check where the expected activity occurred.
Prerequisites
Before you start, make sure you have:
- Linux, Apple Silicon macOS, or native Windows 10/11 on x64 or ARM64; Windows Subsystem for Linux 2 (WSL2) is also supported
- Hermes Agent with native Relay support, plugin diagnostics in
hermes doctor, andchat --oneshot - A configured Hermes Agent model with inference access: a provider API key or a supported authenticated session
- Permission to install Hermes Agent in your user environment
For the Unix-shell instructions, install jq 1.6 or newer and check your version
with jq --version. PowerShell uses its built-in JSON parser.
Install
Install Hermes Agent using the commands for your platform:
Unix shell
Windows PowerShell
On Windows, open a new PowerShell terminal after installation if hermes is not
found. Hermes Agent uses Git Bash internally for its terminal tool; WSL2 is
optional. Refer to the Hermes Agent native Windows guide
for installation and tool prerequisites. These instructions run Hermes Agent from
the command line in the shell where you select the Relay configuration.
Complete the setup prompts and confirm that hermes can use your model
provider before continuing. Check that hermes chat --help lists --oneshot;
older builds can lack support for this recipe.
If Hermes Agent does not yet have a working provider and model, configure one
with hermes model. For example, select the NVIDIA provider, supply an
NVIDIA API key, and choose an
available build.nvidia.com model.
Relay does not choose the model. If Hermes Agent already has a working provider and model, keep that configuration. Hermes Agent manages its supported Relay dependency version.
Use an NVIDIA Endpoint (Optional)
Any working Hermes Agent provider and model can complete this quick start on
Windows or Unix. If you have access to another NVIDIA-compatible endpoint, set
NVIDIA_API_KEY using your usual credential mechanism and set NVIDIA_BASE_URL
in the same shell before continuing to Configure.
The following example uses https://inference-api.nvidia.com/v1 and model
nvidia/nvidia/Nemotron-3-Nano-30B-A3B. Use these values only if your account can
access that endpoint and model; otherwise use the values for your deployment.
The base URL ends in /v1; do not append /chat/completions.
Unix shell
Windows PowerShell
In the Run step, keep the cleanup commands and replace only the
hermes chat command with the following command, which works in either shell.
Keep the PowerShell exit-code check immediately after it:
The explicit provider keeps Hermes Agent from inferring a different provider from the model name. Preserve the model ID exactly as your endpoint expects it.
Configure
Create a disposable working directory and make sure the agent can write files there:
Unix shell
Windows PowerShell
Save the following files and run the remaining commands from this directory.
Save the following configuration as plugins.toml in the directory where you
will start Hermes Agent. Use UTF-8 encoding without a byte order mark:
Select that file and change its file sink to an absolute project logs directory.
An absolute configuration path does not anchor a relative output path: Hermes
Agent can run its gateway from its own installation directory. These commands
adapt the saved template so events stay in this project’s logs directory:
Unix shell
Windows PowerShell
If you repeat these configuration commands, save a fresh copy of the template
first; they expect its original output_directory = "logs" setting.
Hermes Agent can reuse a gateway that remains alive after a one-shot command. An existing gateway retains its Relay configuration. In a dedicated quick-start installation or context, stop its existing gateway after changing the configuration, so the next run starts a process with the selected file:
Run this command only for a gateway dedicated to this quick start. If your
gateway serves other work, use a separate Hermes Agent installation or dedicated
gateway for the trial. Do not use hermes gateway stop --all.
Run the diagnostic in that same shell:
In the NeMo Relay Plugins section, confirm that the selected file is listed, plugins are enabled, and no Relay configuration problems are reported. If the section is missing, update Hermes Agent before continuing. Resolve problems in NeMo Relay Plugins and your selected inference provider. If the diagnostic says NeMo Relay is unavailable on this platform, the installation cannot capture the events required by this quick start; check the supported installation for your operating system and architecture.
hermes doctor checks configuration without loading plugin code. It also checks
optional services unrelated to Relay and can exit nonzero when they are
unconfigured; those warnings do not require enabling the services for this quick
start.
Hermes Agent does not discover repository-local configuration automatically. The explicit path replaces the user configuration file; system configuration still applies. Relay plugins affect every profile hosted in the same Hermes Agent process. Use separate processes when profiles require different plugin policies.
ATOF output can contain sensitive prompts, responses, tool arguments, and tool
results. Working-directory paths can reveal usernames and repository names.
Protect logs/events.jsonl even when full payload export is disabled.
Run
From the same directory, run a one-shot turn with the common validation prompt:
Unix shell
Windows PowerShell
The one-shot command completes its Relay session before exiting, allowing the
required lifecycle records to finish writing. Its gateway can remain running;
repeat the configuration and gateway steps before another run if you change
plugins.toml or its selection.
Verify
The tool marker proves that the agent created the requested file. The event marker proves that Relay recorded matching start/end records for the required turn or agent, tool, and model work. The response marker is the agent’s reply; it is checked separately from the captured lifecycle.
The verification command prints RELAY_QUICKSTART_TOOL_OK and RELAY_QUICKSTART_EVENTS_OK.
Run the verification checks
Run these checks after Hermes Agent exits:
Unix shell
Windows PowerShell
The verification command prints the following output when its checks pass:
The agent’s final reply should include RELAY_QUICKSTART_RESPONSE_OK; its
surrounding wording can vary.
These markers confirm the tool-created file and matching start/end records for agent, tool, and LLM work.
Inspect the Recorded Activity
Read the completed model calls from the same event file:
Unix shell
Windows PowerShell
category and name identify the recorded work. The same uuid pairs its
start and end records; parent_uuid connects it to its enclosing scope.
timestamp records when this event occurred. For model calls, category_profile
and metadata can include the model identity and completion status, depending
on the integration. These fields let you follow a call through the run without
requiring full prompt or response capture.
For More Details
For more details, refer to: