Scan Trace Data

View as Markdown

Use the telemetry scan to check an agent’s trace data for PII and leaked credentials before you reuse those traces. Agent traces are the input to evaluation and optimization, so sensitive data captured in a trace spreads into every dataset built from it.

The scan samples recent files from the nemo-agent-telemetry fileset, runs a pattern match over them, and writes findings with masked previews, file locations and follow-up actions to nemo-agent-security.

What the Scan Looks For

Finding typeSignalResult
Leaked credentialsPrivate keys, JWTs and common model-provider API keysRotate the credential, then clean up the trace
PIIEmail addresses, SSNs, phone numbers and credit card numbersRedact or regenerate the affected traces
Deep scanPattern matching is not enough for the data risk profileSuggests a higher-recall GLiNER or NemoGuard check on a subset of traces

Matching is pattern-based, so it’s most reliable on credentials, which have fixed published formats. For broader entity coverage, including names and locations, run a deep scan or use Anonymizer.

Rotate or revoke leaked credentials promptly to block further use. Rotation does not prove the credential went unused or that no data was accessed before it happened, so preserve the trace as evidence and investigate prior access before cleaning it up.

Prerequisites

Before scanning telemetry, make sure you have:

  1. Local services running (nemo services run).
  2. At least one deployed platform-managed agent.
  3. Telemetry in the nemo-agent-telemetry fileset. The agent must use the nemo_files telemetry exporter and have completed recent invocations. See Observe Agents.

Run the Scan

nemo files list nemo-agent-telemetry

Inspect the most recent trace files, or use the security skill to do it for you. Cap the data you download, because telemetry can be large.

Review Findings

Findings are written to the nemo-agent-security fileset:

  • security_snapshot.json
  • security_suggestions.jsonl

Use the Files service to inspect them:

nemo files list nemo-agent-security
nemo files download nemo-agent-security \
--remote-path security_suggestions.jsonl \
-o security_suggestions.jsonl

Troubleshooting

No findings were written. Confirm the nemo-agent-security fileset exists with nemo files list nemo-agent-security. If it is empty, the scan has not run yet.

The fileset is empty even after scanning. Scans require telemetry. Confirm the nemo-agent-telemetry fileset exists with nemo files list nemo-agent-telemetry. If it is empty, the agent is not exporting traces. Verify the agent uses the nemo_files telemetry exporter and that recent invocations have completed.

The agents-secure skill is not available. Run nemo skills list to confirm the skill is installed. If it is missing, install it with nemo skills install --agent <claude|codex|cursor|opencode>.

  • Observe Agents: ingest and query the telemetry this scan reads.
  • Anonymizer: detect and replace sensitive entities across a dataset.