Basic Audit Target#

When you run an audit job in NVIDIA NeMo Auditor, you create a separate audit target and audit configuration for the job.

The target specifies the model name, model type, and free-form key-value pairs for model-specific inference options. For more information, refer to Schema for Audit Targets.

The following target references the NVIDIA Nemotron Nano 12B V2 VL model from build.nvidia.com. If you deployed with Docker, this is a good target for getting started.

Set the AUDITOR_BASE_URL environment variable to the NeMo Auditor service endpoint. Refer to Accessing the Microservice for more information.

Python SDK

import os
from nemo_microservices import NeMoMicroservices

client = NeMoMicroservices(base_url=os.getenv("AUDITOR_BASE_URL"))

target = client.beta.audit.targets.create(
    namespace="default",
    name="demo-basic-target",
    type="nim.NVOpenAIChat",
    model="nvidia/nemotron-nano-12b-v2-vl",
    options={
        "nim": {
            "skip_seq_start": "<think>",
            "skip_seq_end": "</think>",
            "max_tokens": 3200,
            "uri": "https://integrate.api.nvidia.com/v1/"
        }
    }
)

print(target.model_dump_json(indent=2))

cURL

curl -X POST "${AUDITOR_BASE_URL}/v1beta1/audit/targets" \
  -H "Accept: application/json" \
  -H "Content-Type: application/json" \
  -d '{
    "namespace": "default",
    "name": "demo-basic-target",
    "type": "nim.NVOpenAIChat",
    "model": "nvidia/nemotron-nano-12b-v2-vl",
    "options": {
      "nim": {
          "skip_seq_start": "<think>",
          "skip_seq_end": "</think>",
          "max_tokens": 3200,
          "uri": "https://integrate.api.nvidia.com/v1/"
      }
    }
  }' | jq

Basic Audit Target#

Next Steps#