DeepSeek-V2
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
DeepSeek-V2 — MLA (Multi-head Latent Attention)
Why it matters
A third path, distinct from MQA and GQA, that compresses KV into a low-dimensional latent
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2405.04434Added in Week 35, 2026 · See that week
On the map — ⑪ Model Architecture line
- Previous stopStreamingLLM
- This record · stopDeepSeek-V2
- Next stopByte Latent Transformer
In the model family tree — DeepSeek family · 12 versions
- Earlier versionDeepSeek LLM
- This recordDeepSeek-V2
- Later versionDeepSeek-V3