Anthropic
CoBench and operational automation included. Internal tasks are not public; lab disclosure is not independent replication.
Official site ↗Organizations
Published evidence grouped by organization.
CoBench and operational automation included. Internal tasks are not public; lab disclosure is not independent replication.
Official site ↗Current AI self-improvement suite plus original MLE-bench and PaperBench. Graph-only scores withheld.
Official site ↗GRB, a qualitative RE-Bench assessment and AlphaEvolve. Different internal metrics cannot rank labs.
Official site ↗Independent evaluations, task horizons and productivity studies. Selected historical snapshots, not a live leaderboard.
Official site ↗Original benchmark-author report; no independent replication included.
Official site ↗Historical v1 study; later revisions require separate reconciliation.
Official site ↗Only the Llama 3.1 evaluation reported by MLE-bench authors is included.
Official site ↗Only Kimi K3 in the original AI4AI-Bench study is included.
Official site ↗Source-authored research, with classification separated from independent empirical verification.
Official site ↗Source-authored research, with classification separated from independent empirical verification.
Official site ↗Organization of Grok 4 in METR's historical TH1 table.
Official site ↗Organization of DeepSeek-R1 in PaperBench's original Table 4.
Official site ↗Original academic preprint authors; no institutional endorsement inferred.
Official site ↗Creators of the original full benchmark and its maintained v1.1 leaderboard.
Official site ↗External Locus submission reviewed for v1.1 compliance by the benchmark team.
Official site ↗Organization attribution for GLM 5.2; benchmark agent used Claude Code.
Official site ↗Publishes the September 2026 working paper. Author affiliations do not imply institutional endorsement.
Official site ↗Independent benchmark reviewer; review does not independently replicate every leaderboard result.
Official site ↗Author-maintained toolkit; the guest article discloses an Anthropic visiting appointment and states BootLoops is not an Anthropic project.
Official site ↗Source authorship/evaluator attribution; not an evaluated system or a claim of organization-wide performance.
Official site ↗Source authorship/evaluator attribution; not an evaluated system or a claim of organization-wide performance.
Official site ↗Source authorship/evaluator attribution; not an evaluated system or a claim of organization-wide performance.
Official site ↗Source authorship/evaluator attribution; not an evaluated system or a claim of organization-wide performance.
Official site ↗Research collaboration credited by this paper; attribution does not imply an independent replication.
Official site ↗Research collaboration credited by this paper; attribution does not imply an independent replication.
Official site ↗Author group for the MASS two-cycle study; affiliation is not independent scientific endorsement.
Official site ↗Authors affiliated with Institute of Automation, CAS and University of Chinese Academy of Sciences; source-reported benchmark evidence.
Official site ↗Creator of FrontierSWE; this draft indexes the v2 report and a harness comparison, with full benchmark-result records pending separate review.
Official site ↗Author group for two separate FML-bench preprints; retain each paper and protocol independently.
Official site ↗Publisher of an explanatory essay informed by anonymous frontier-lab conversations. Inclusion attributes a perspective; no official lab endorsement or empirical RSI evidence established.
Official site ↗Author cohort for the October 21, 2026 physical RSI survey; not a claim of a separate institution.
Official site ↗Bibliographic author cohort for the November 3, 2026 preprint, not a separate institution.
Official site ↗