nemo_microservices.types.evaluation_config#
Module Contents#
Classes#
API#
- class nemo_microservices.types.evaluation_config.EvaluationConfig(/, **data: Any)#
Bases:
nemo_microservices._models.BaseModel- created_at: datetime.datetime | None#
None
Timestamp for when the entity was created.
- custom_fields: Dict[str, object] | None#
None
A set of custom fields that the user can define and use for various purposes.
- description: str | None#
None
The description of the entity.
- groups: Dict[str, nemo_microservices.types.group_config.GroupConfig] | None#
None
Evaluation tasks belonging to the evaluation.
- id: str | None#
None
The ID of the entity.
With the exception of namespaces, this is always a semantically-prefixed base58-encoded uuid4 [
-base58(uuid4())].
- name: str | None#
None
The name of the entity.
Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.
- namespace: str | None#
None
The namespace of the entity.
This can be missing for namespace entities or in deployments that don’t use namespaces.
- ownership: nemo_microservices.types.shared.ownership.Ownership | None#
None
Information about ownership of an entity.
If the entity is a namespace, the
access_policieswill typically apply to all entities inside the namespace.
- params: nemo_microservices.types.evaluation_params.EvaluationParams | None#
None
Global parameters for an evaluation.
- project: str | None#
None
The URN of the project associated with this entity.
- schema_version: str | None#
None
The version of the schema for the object. Internal use only.
- tasks: Dict[str, nemo_microservices.types.task_config.TaskConfig] | None#
None
Evaluation tasks belonging to the evaluation.
- type: str#
None
The type of the evaluation, e.g., ‘mmlu’, ‘big_code’.For custom evaluations, this is set to
custom.
- type_prefix: str | None#
None
- updated_at: datetime.datetime | None#
None
Timestamp for when the entity was last updated.