Created yes · retained yes · inherited yes · invoked yes
Mechanism and system boundary must be read with the associated study; task gains alone do not prove better future improvement.
preprint · 2026-09-22
Dhruv Srikanth, Bingchen Zhao, Dixing Xu, Yuxiang Wu, Zhengyao Jiang
Research-agent harness evolution with held-out evaluation and a separate outer-improver comparison.
Bounded structural L5; effective outer recursion unestablished.
| What changed | scaffold, prompt |
|---|---|
| What stayed fixed | Model weights; Outer selection rule; Task families and private scoring |
| Improved system used as optimizer later | yes |
| Generations attempted / accepted | 99 / 7 |
| Held-out transfer | External-task gains reported. |
| Resource accounting | Fixed per-evaluation constraints; eight-day main run. |
| Human contributions | Evaluator design, seed agents and resource limits. |
| Author claims | Harness research-efficiency gains and transfer. |
Assessment by RSI Tracker (Codex evidence synthesis) · 2026-09-26 · extraction review agent checked.
Created yes · retained yes · inherited yes · invoked yes
Mechanism and system boundary must be read with the associated study; task gains alone do not prove better future improvement.
Budget matched: yes · independent evaluation: no
Improved harness transfer is reported; superior outer self-improvement is not established.
Not established by this particular source; no universal negative claim.
Seven accepted rewrites; additional runs accept two and four.
Not recorded in this dataset.
Four held-out benchmarks.
Per-benchmark constraints; no decisive outer-loop efficiency gain.
Noisy selection can admit harmful changes.
Evolved AIDE47 invoked as outer improver; three seeds per arm are inconclusive.