nemo_microservices.types.evaluation.target_update_params

Module Contents

Classes

TargetUpdateParams

Data

Dataset
Model

API

nemo_microservices.types.evaluation.target_update_params.Dataset: typing_extensions.TypeAlias

None

nemo_microservices.types.evaluation.target_update_params.Model: typing_extensions.TypeAlias

None

class nemo_microservices.types.evaluation.target_update_params.TargetUpdateParams

Bases: typing_extensions.TypedDict

cached_outputs: nemo_microservices.types.cached_outputs_data_param.CachedOutputsDataParam

None

An evaluation target which contains cached outputs.

custom_fields: Dict[str, object]

None

A set of custom fields that the user can define and use for various purposes.

dataset: Dataset

None

Dataset to be evaluated.

description: str

None

The description of the entity.

model: Model

None

The model to be evaluated.

namespace: typing_extensions.Required[str]

None

ownership: nemo_microservices.types.shared_params.ownership.Ownership

None

Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

project: str

None

The URN of the project associated with this entity.

rag: nemo_microservices.types.rag_target_param.RagTargetParam

None

RAG to be evaluated.

retriever: nemo_microservices.types.retriever_target_param.RetrieverTargetParam

None

Retriever to be evaluated.

rows: Iterable[Dict[str, object]]

None

Rows to be evaluated.

type: nemo_microservices.types.target_type.TargetType

None

The type of the evaluation target, e.g., ‘model’, ‘retriever’, ‘rag’.