RAG, Fine-Tuning & ContextMichael Günther et al. (Jina AI)Jina AI

Jina AI presents Late Chunking

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Late Chunking presented — the whole document is first passed through a long-context embedding model, then the token embeddings are pooled chunk by chunk

Why it matters

Solved the problem of chunking cutting off context by changing the order of embedding

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2409.04701

Added in Week 35, 2026 · See that week

On the map — ② RAG, Fine-Tuning line

  1. Previous stopPrompt caching
  2. This recordLate Chunking
  3. Next stopNoLiMa
See it on the map

Nearby on the same axis

Contextual RetrievalOfficialAnthropic launches prompt caching in public betaOfficialAPI Prompt CachingOfficialContext Caching on DiskOfficial