RAG, Fine-Tuning & ContextAli Modarressi et al. (LMU Munich, MCML, Adobe Research)LMU Munich

Modarressi et al. present NoLiMa

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Presented NoLiMa — in a long-context evaluation with literal overlap removed, many models dropped below 50% of their short-context performance at 32K

Why it matters

Showed that needle-in-a-haystack scores overstate long-context ability

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2502.05167

Added in Week 35, 2026 · See that week

On the map — ② RAG, Fine-Tuning line

  1. Previous stopPrompt caching
  2. This record · stopNoLiMa
  3. Next stopContext editing and memory tool launch in beta on the Claude API
See it on the map

Same week

Karpathy releases Deep Dive into LLMs like ChatGPT, a 3h31m YouTube lectureOfficialConstitutional ClassifiersOfficial

Nearby on the same axis

Zep releases agent memory built on Graphiti, a temporal knowledge graph enginePaperAditi Singh et al. publish an Agentic RAG surveyPaperXiaoxi Li et al. present Search-o1PaperJin et al. present Search-R1Paper