Mixtral 8x7B

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Mixtral 8x7B — 46.7B total / 12.9B per token, Apache 2.0

Why it matters

Made Sparse MoE a standard architecture of the open ecosystem and imprinted the concept of total versus active parameters

Source — Primary sources first; secondary reports are labelled “Press”

Officialmistral.aihttps://mistral.ai/news/mixtral-of-experts

Added in Week 35, 2026 · See that week

On the map — ⑨ Open-Weight Lineage line

  1. Previous stopMistral 7B
  2. This record · stopMixtral 8x7B
  3. Next stopMistral Large
See it on the map

In the model family tree — Mistral family · 13 versions

  1. Earlier versionMistral 7B
  2. This recordMixtral 8x7B
  3. Later versionMistral Large
See the whole Mistral family

Same week

Weak-to-strong generalizationOfficialUpstage releases SOLAR 10.7BOfficialSGLang paperPaper

Nearby on the same axis

Upstage releases SOLAR 10.7BOfficialDeepSeek releases DeepSeek LLM 7B and 67BOfficialGemma 1 (2B/7B), under Gemma's own terms of usePressMistral 7BOfficial