Evidence record

CoBench

Prior version (label unspecified) · Claude Opus 5 · 2026-09-22

Reported result · numeric

59.6%

Reported score · percent

lab reported · extraction review: agent checked

Source and extraction

Published 2026-09-22

Evaluation setup

comparability caveatsPrior environment details not re-established.

Not reported: split, task count, task snapshot, attempts per task, run count, selection rule, aggregate method, token budget, wall clock budget, hardware, training budget, inference budget, monetary cost, tool access, internet access, filtering, scaffold, evaluator version, human intervention, task exclusions, contamination concerns.

Comparability

Not compared with other results.

Limitations

  • Historical score restated September 22; original publication/evaluation date not established. No comparison group assigned.
  • Environment changed between versions; scores are not comparable across versions.
  • Private historical infrastructure and model-graded root-cause rubrics limit external replication.