TargetCreateParams

class nemo_microservices.types.evaluation.TargetCreateParams

Bases: TypedDict

type: Required[Literal['model', 'cached_outputs', 'retriever', 'rag', 'rows', 'dataset']]

The type of the evaluation target, e.g., ‘model’, ‘retriever’, ‘rag’.

cached_outputs: CachedOutputsDataParam

An evaluation target which contains cached outputs.

custom_fields: Dict[str, str]

A set of custom fields that the user can define and use for various purposes.

dataset: str | DatasetEvParam

Dataset to be evaluated.

description: str

The description of the entity.

model: str | ModelEvParam

The model to be evaluated.

name: str

The name of the entity.

Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

namespace: str

The namespace of the entity.

This can be missing for namespace entities or in deployments that don’t use namespaces.

ownership: Ownership

Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

project: str

The URN of the project associated with this entity.

rag: RagTargetParam

RAG to be evaluated.

retriever: RetrieverTargetParam

Retriever to be evaluated.

rows: Iterable[object]

Rows to be evaluated.