Back to the discovery

Source record · 2026

We are Changing our Developer Productivity Experiment Design

Joel Becker, Nate Rush, Tom Cunningham, David Rein and Khalid Mahamud

Type
Research organization’s methodological update
Publication
METR
Version used
Published original
Source date
24 February 2026
Recorded in Atlas
5 November 2026
License
Atlas paraphrase and original figures; no source artwork reproduced. Consult the original for reuse terms.

Update distinguishes early-2025 results from later data affected by recruitment, task-selection and timing problems. No reliable current speedup inferred. No separate validity period has been established for the finding.


How Atlas uses this source

The CTO’s AI mandate

Opening findings and Wider adoption of AI has made it more difficult to measure task-level productivity

Recruitment, submitted tasks, changed pay and concurrent work complicated comparison.

Open the source passage