Unpin Evaluation

DELETE

///apis/intake/v2/workspaces/:workspace/evaluations/:name/pin

DELETE

/apis/intake/v2/workspaces/:workspace/evaluations/:name/pin

curl -X DELETE /apis/intake/v2/workspaces/workspace/evaluations/name/pin

{
  "id": "string",
  "name": "string",
  "workspace": "string",
  "experiment_ids": [
    "string"
  ],
  "dataset_name": "string",
  "experiment_group_id": "string",
  "dataset_version": "string",
  "source_link": "string",
  "metadata": {},
  "description": "string",
  "parent_evaluation_id": "string",
  "status": "string",
  "root_cause": "string",
  "created_at": "2024-01-15T09:30:00Z",
  "updated_at": "2024-01-15T09:30:00Z",
  "pinned_at": "2024-01-15T09:30:00Z",
  "evaluator_names": [
    "string"
  ],
  "model_names": [
    "string"
  ],
  "agent_names": [
    "string"
  ],
  "agent_versions": [
    "string"
  ],
  "aggregate_scores": {},
  "run_count": 0,
  "test_case_count": 0,
  "cost_usd": {
    "sum": 1.1,
    "mean": 1.1,
    "median": 1.1,
    "p90": 1.1,
    "p95": 1.1,
    "p99": 1.1,
    "count": 0,
    "failed_count": 0
  },
  "latency_ms": {
    "sum": 1.1,
    "mean": 1.1,
    "median": 1.1,
    "p90": 1.1,
    "p95": 1.1,
    "p99": 1.1,
    "count": 0,
    "failed_count": 0
  },
  "tokens": {
    "sum": 1.1,
    "mean": 1.1,
    "median": 1.1,
    "p90": 1.1,
    "p95": 1.1,
    "p99": 1.1,
    "count": 0,
    "failed_count": 0
  }
}

Unpin an evaluation. Idempotent: unpinning an already-unpinned evaluation is a no-op.

Path parameters

workspacestringRequired

namestringRequired

Response

Successful Response

idstring

namestring

workspacestring

experiment_idslist of strings

Entity ids of the Experiments this Evaluation belongs to (>=1).

dataset_namestring

experiment_group_idstringRead-onlyDeprecated

Deprecated single-experiment alias; the first of experiment_ids. Use experiment_ids.

dataset_versionstringOptional

source_linkstringOptionalformat: "uri">=1 character

metadatamap from strings to stringsOptional

descriptionstringOptional

parent_evaluation_idstringOptional

statusstringOptional

root_causestringOptional

created_atdatetimeOptional

updated_atdatetimeOptional

pinned_atdatetime or nullOptional

Timestamp at which the evaluation was pinned, or null if unpinned. Managed via POST/DELETE /evaluations/{name}/pin.

evaluator_nameslist of stringsOptional

model_nameslist of stringsOptional

Distinct model names observed across ingested sessions for this evaluation.

agent_nameslist of stringsOptional

Distinct agent names observed across ingested sessions for this evaluation.

agent_versionslist of stringsOptional

Distinct agent versions observed across ingested sessions for this evaluation.

aggregate_scoresmap from strings to objectsOptional

run_countintegerOptionalDefaults to 0

Number of distinct ingested evaluation sessions; one session is treated as one run.

test_case_countintegerOptionalDefaults to 0

Number of distinct test cases in the evaluation, i.e. distinct test_case_name values (sessions with no test_case_name each count as their own). A test case run k times counts once; the rollup metrics are averaged per test case before pooling across test cases.

cost_usdobjectOptional

Aggregate statistics over evaluator scores or session-level metric values.

latency_msobjectOptional

Aggregate statistics over evaluator scores or session-level metric values.

tokensobjectOptional

Average total tokens (input + output) per test case, aggregated across the evaluation.

Errors

404

Not Found Error

422

Unprocessable Entity Error