report · 2025-07-10

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

METR · Joel Becker, Nate Rush, Beth Barnes, David Rein

On this page

Why it matters here

Randomized AI access slowed this sample of experienced developers, illustrating why benchmark gains need real-work validation.

Read original source ↗

Observed R&D automation

What to keep in mind

  • Narrow population and early-2025 tools.