Response
Successful Response
experiment_idslist of strings
Entity ids of the Experiments this Evaluation belongs to (>=1).
experiment_group_idstringRead-onlyDeprecated
Deprecated single-experiment alias; the first of experiment_ids. Use experiment_ids.
dataset_versionstringOptional
source_linkstringOptionalformat: "uri">=1 character
metadatamap from strings to stringsOptional
descriptionstringOptional
parent_evaluation_idstringOptional
created_atdatetimeOptional
updated_atdatetimeOptional
pinned_atdatetime or nullOptional
Timestamp at which the evaluation was pinned, or null if unpinned. Managed via POST/DELETE /evaluations/{name}/pin.
evaluator_nameslist of stringsOptional
model_nameslist of stringsOptional
Distinct model names observed across ingested sessions for this evaluation.
agent_nameslist of stringsOptional
Distinct agent names observed across ingested sessions for this evaluation.
agent_versionslist of stringsOptional
Distinct agent versions observed across ingested sessions for this evaluation.
aggregate_scoresmap from strings to objectsOptional
run_countintegerOptionalDefaults to 0
Number of distinct ingested evaluation sessions; one session is treated as one run.
test_case_countintegerOptionalDefaults to 0
Number of distinct test cases in the evaluation, i.e. distinct test_case_name values (sessions with no test_case_name each count as their own). A test case run k times counts once; the rollup metrics are averaged per test case before pooling across test cases.
cost_usdobjectOptional
Aggregate statistics over evaluator scores or session-level metric values.
latency_msobjectOptional
Aggregate statistics over evaluator scores or session-level metric values.
tokensobjectOptional
Average total tokens (input + output) per test case, aggregated across the evaluation.
