NVIDIA NeMo Agent Toolkit: Observing a Workflow with Arize AX#
This guide shows how to send OpenTelemetry traces from NeMo Agent Toolkit to Arize AX using the built-in arize_ax exporter (nvidia-nat[opentelemetry]). For field reference and custom OTLP endpoints, see Adding Telemetry Exporters — Arize AX.
Step 1: Arize space and API key#
In the Arize AX UI, open your space and create or select a project for trace ingestion. You need the space ID and an API key with permission to send OTLP data. Official OTLP details: OpenTelemetry with Arize OTel.
Step 2: Configure the environment#
export ARIZE_SPACE_ID="<your-space-id>"
export ARIZE_API_KEY="<your-api-key>"
# Optional: overrides the default in config-arize-ax.yml (${ARIZE_PROJECT_NAME:-simple_calculator})
export ARIZE_PROJECT_NAME="simple_calculator"
For EU data residency, set use_eu_region: true under general.telemetry.tracing.arize_ax in your config (see the example file below).
Step 3: Install the OpenTelemetry extra#
uv pip install -e ".[opentelemetry]"
# or, from PyPI: uv pip install "nvidia-nat[opentelemetry]"
Step 4: Run the simple calculator observability example#
From the root of the NeMo Agent Toolkit repository:
uv pip install -e examples/observability/simple_calculator_observability/
nat run --config_file examples/observability/simple_calculator_observability/configs/config-arize-ax.yml --input "What is 2 * 4?"
You should see a log line such as Started exporter 'arize_ax'. Open the Arize project matching ARIZE_PROJECT_NAME to view traces.