METR publishes an official note on the limits of its time horizon metric

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Published an official note setting out the limitations of the time horizon metric — states an error range of about 2x and that the task distribution is unclear

Why it matters

A case of the issuing organization itself putting the brakes on its own metric being over-generalized when cited

Source — Primary sources first; secondary reports are labelled “Press”

Officialmetr.orghttps://metr.org/notes/2026-01-22-time-horizon-limitations/

Added in Week 35, 2026 · See that week

On the map — ⑯ Evaluation line

  1. Previous stopGDPval
  2. This recordMETR publishes an official note on the limits of its time horizon metric
  3. Next stopTime Horizon 1.1
See it on the map

Same week

Attorneys general of 35 US states and territories send joint letter to xAIGovernmentAnthropic releases a fully revised Claude's ConstitutionOfficialKorea's AI Basic Act and its Enforcement Decree take effectPressPyTorch Foundation releases PyTorch 2.10Official

Nearby on the same axis

LMArena renames itself ArenaOfficialMETR releases Time Horizon 1.1OfficialWhy SWE-bench Verified no longer measures frontier coding capabilitiesOfficialARC Prize releases ARC-AGI-3Official