Get Evaluation Job Status#
To get the status of an evaluation job, send a GET
request to the jobs endpoint, as shown in the following code.
Job Status Values#
Status |
Description |
---|---|
|
The job is created, but not yet scheduled. |
|
The job is waiting for resource allocation. |
|
The job is currently running. |
|
The job has completed successfully. |
|
The job has been cancelled by the user. |
|
The job failed to run and terminated. |
Progress Information#
The status response includes progress tracking information:
Field |
Description |
---|---|
|
Completion percentage (0.0-100.0) when |
|
Number of dataset samples that have been processed during the evaluation. |
|
Status of individual evaluation tasks. Each task can be |
Progress Calculation#
Progress percentage is only calculated when you set the limit_samples
parameter in your evaluation configuration. This allows the system to calculate completion as samples_processed / limit_samples * 100
.
To Get Evaluation Job Status#
Choose one of the following options to get evaluation job status.
import os
from nemo_microservices import NeMoMicroservices
# Initialize the client
client = NeMoMicroservices(
base_url=os.environ['EVALUATOR_BASE_URL']
)
# Get job status
status_response = client.evaluation.jobs.status("job-id")
# Get the status details
print(f"Status: {status_response.status}")
print(f"Message: {status_response.message}")
print(f"Progress: {status_response.progress}")
curl -X "GET" "${EVALUATOR_BASE_URL}/v1/evaluation/jobs/<job-id>/status" \
-H 'accept: application/json'
Example Response
{
"message": "Job is running",
"task_status": {
"question-answering": "running"
},
"progress": 42.5,
"samples_processed": 85
}