Get Evaluation Job Status#

To get the status of an evaluation job, send a GET request to the jobs endpoint, as shown in the following code.

Job Status Values#

Evaluation Job Status Values#

Status

Description

CREATED

The job is created, but not yet scheduled.

PENDING

The job is waiting for resource allocation.

RUNNING

The job is currently running.

COMPLETED

The job has completed successfully.

CANCELLED

The job has been cancelled by the user.

FAILED

The job failed to run and terminated.

Progress Information#

The status response includes progress tracking information:

Progress Tracking Fields#

Field

Description

progress

Completion percentage (0.0-100.0) when limit_samples is set in the evaluation configuration. Returns null if limit_samples is not specified.

samples_processed

Number of dataset samples that have been processed during the evaluation.

task_status

Status of individual evaluation tasks. Each task can be PENDING, RUNNING, COMPLETED, or FAILED.

Progress Calculation#

Progress percentage is only calculated when you set the limit_samples parameter in your evaluation configuration. This allows the system to calculate completion as samples_processed / limit_samples * 100.

To Get Evaluation Job Status#

Choose one of the following options to get evaluation job status.

import os
from nemo_microservices import NeMoMicroservices

# Initialize the client
client = NeMoMicroservices(
    base_url=os.environ['EVALUATOR_BASE_URL']
)

# Get job status
status_response = client.evaluation.jobs.status("job-id")

# Get the status details
print(f"Status: {status_response.status}")
print(f"Message: {status_response.message}")
print(f"Progress: {status_response.progress}")
curl -X "GET" "${EVALUATOR_BASE_URL}/v1/evaluation/jobs/<job-id>/status" \
  -H 'accept: application/json'
Example Response
{
    "message": "Job is running",
    "task_status": {
        "question-answering": "running"
    },
    "progress": 42.5,
    "samples_processed": 85
}