EvaluationTarget

class nemo_microservices.types.EvaluationTarget(*args: Any, **kwargs: Any)

Bases: BaseModel

type: Literal['model', 'cached_outputs', 'retriever', 'rag', 'rows', 'dataset']

The type of the evaluation target, e.g., ‘model’, ‘retriever’, ‘rag’.

id: str | None = None

The ID of the entity.

With the exception of namespaces, this is always a semantically-prefixed base58-encoded uuid4 [<prefix>-base58(uuid4())].

cached_outputs: CachedOutputsData | None = None

An evaluation target which contains cached outputs.

created_at: datetime | None = None

Timestamp for when the entity was created.

custom_fields: Dict[str, str] | None = None

A set of custom fields that the user can define and use for various purposes.

dataset: str | DatasetEv | None = None

Dataset to be evaluated.

description: str | None = None

The description of the entity.

model: str | ModelEv | None = None

The model to be evaluated.

name: str | None = None

The name of the entity.

Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

namespace: str | None = None

The namespace of the entity.

This can be missing for namespace entities or in deployments that don’t use namespaces.

ownership: Ownership | None = None

Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

project: str | None = None

The URN of the project associated with this entity.

rag: RagTarget | None = None

RAG to be evaluated.

retriever: RetrieverTarget | None = None

Retriever to be evaluated.

rows: List[object] | None = None

Rows to be evaluated.

schema_version: str | None = None

The version of the schema for the object. Internal use only.

type_prefix: str | None = None

updated_at: datetime | None = None

Timestamp for when the entity was last updated.