LiveEvaluation#

class nemo_microservices.types.LiveEvaluation(*args: Any, **kwargs: Any)

Bases: BaseModel

logs: object | None = None

Logs of task for live evaluation

result: EvaluationResult | None = None

The result of an evaluation job.

status: Literal['created', 'pending', 'running', 'cancelled', 'cancelling', 'failed', 'completed', 'ready', 'unknown'] | None = None

Normalized statuses for all jobs.

  • CREATED: The job is created, but not yet scheduled.

  • PENDING: The job is waiting for resource allocation.

  • RUNNING: The job is currently running.

  • CANCELLING: The job is being cancelled at the user’s request.

  • CANCELLED: The job has been cancelled by the user.

  • CANCELLING: The job is being cancelled at the user’s request.

  • FAILED: The job failed to execute and terminated.

  • COMPLETED: The job has completed successfully.

  • READY: The job is ready to be used.

  • UNKNOWN: The job status is unknown.

status_details: EvaluationStatusDetails | None = None

Details about the status of the evaluation.