Model Architecture & Training MethodsBo Peng et al.

RWKV

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

RWKV

Why it matters

Restructured the RNN so it can be trained at Transformer level; the opening signal of a revival of linear complexity

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2305.13048

Added in Week 35, 2026 · See that week

On the map — ⑪ Model Architecture line

  1. Previous stopSolidGoldMagikarp
  2. This recordRWKV
  3. Next stopStreamingLLM
See it on the map

Same week

RAP (Reasoning via Planning) publishedPaperMultiagent Debate publishedPaperQLoRAPaperGQAPaper

Nearby on the same axis

GQAPaperAre Emergent Abilities a Mirage?PaperYaRNPaperSolidGoldMagikarpOfficial