Tools & AgentsMeta, HuggingFace (Mialon et al.)MetaHugging Face

GAIA benchmark

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

GAIA benchmark

Why it matters

On 466 questions, humans scored 92% versus 15% for GPT-4 with plugins; shifted the focus of evaluation from hard exams to practical ability

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2311.12983

Added in Week 35, 2026 · See that week

On the map — ③ Tools & Agents line

  1. Previous stopWebArena
  2. This record · stopGAIA benchmark
  3. Next stopClaude tool use
See it on the map

Same week

Andrej Karpathy posts Intro to Large Language Models on YouTubeOfficialAnthropic releases Claude 2.1 with a 200K-token contextOfficialGreg Kamradt publishes the needle-in-a-haystack long-context recall stress testPressGPQA releasedPaper

Nearby on the same axis

João Moura publishes the first CrewAI release on PyPIOfficialDevDayOfficialAutoGenPaperMetaGPTPaper