preprint · 2025-04-02
PaperBench: Evaluating AI’s Ability to Replicate AI Research
On this page
Why it matters here
Paper replication receives partial rubric credit. Changing the agent scaffold helps some models while hurting another.
AI-R&D capabilityResearch autonomy
Related benchmarks and indicators
What to keep in mind
- Historical v1 extraction; not a claim about present frontier performance.