List Evaluation Jobs#

To list all evaluation jobs, send a GET request to the jobs endpoint, as shown in the following code. After you submit the request, a list of all the evaluation jobs is returned, with details for each job. To filter the jobs that the API returns, refer to Filter Jobs.

v2 (Preview)#

Warning

v2 API Preview: The v2 API is available for testing and feedback but is not yet recommended for production use. Breaking changes may occur before the stable release.

import os
from nemo_microservices import NeMoMicroservices

# Initialize the client
client = NeMoMicroservices(
    base_url=os.environ['EVALUATOR_BASE_URL']
)

# List all evaluation jobs (v2 API)
jobs = client.v2.evaluation.jobs.list()

# Iterate through the jobs
for job in jobs:
    print(f"Job ID: {job.id}")
    print(f"Status: {job.status}")
    print(f"Created: {job.created_at}")
    print("---")

curl -X "GET" "${EVALUATOR_BASE_URL}/v2/evaluation/jobs" \
  -H 'accept: application/json'
v2 Example Response
[
  {
    "id": "job-dq1pjj6vj5p64xaeqgvuk4",
    "created_at": "2025-09-08T19:20:32.655254",
    "updated_at": "2025-09-08T19:20:32.655256",
    "spec": {
      "config": {
        "type": "bfclv3",
        "params": {
          "limit_samples": 10
        }
      },
      "target": {
        "type": "model",
        "model": {
          "api_endpoint": {
            "url": "https://nim.int.aire.nvidia.com/v1/chat/completions",
            "model_id": "meta/llama-3.1-8b-instruct",
            "format": "nim"
          }
        }
      }
    },
    "status": "completed",
    "status_details": {},
    "error_details": null
  }
]

v1 (Current)#

Choose one of the following options to list evaluation jobs.

import os
from nemo_microservices import NeMoMicroservices

# Initialize the client
client = NeMoMicroservices(
    base_url=os.environ['EVALUATOR_BASE_URL']
)

# List all evaluation jobs (v1 API)
jobs = client.evaluation.jobs.list()

# Iterate through the jobs
for job in jobs:
    print(f"Job ID: {job.id}")
    print(f"Status: {job.status}")
    print(f"Created: {job.created_at}")
    print("---")

curl -X "GET" "${EVALUATOR_BASE_URL}/v1/evaluation/jobs" \
  -H 'accept: application/json'
On this page