Model Architecture & Training MethodsMeta (Pagnoni et al.)Meta

Byte Latent Transformer

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Byte Latent Transformer

Why it matters

Processes bytes directly, without a fixed vocabulary, using entropy-based dynamic patches; the first large-scale scaling of the tokenizer-free approach

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2412.09871

Added in Week 35, 2026 · See that week

On the map — ⑪ Model Architecture line

  1. Previous stopDeepSeek-V2
  2. This record · stopByte Latent Transformer
  3. Next stopGrok 4 Fast
See it on the map

Same week

Ilya Sutskever gives the NeurIPS 2024 Test of Time talkPressGoogle introduces Gemini 2.0OfficialLG AI Research open-sources EXAONE 3.5Official

Nearby on the same axis

Keller Jordan releases the Muon optimizerOfficialDeepSeek-V3 Technical ReportPaperNSA — Native Sparse AttentionPaperNaver releases a new HyperCLOVA X modelOfficial