SGLang reproduces large-scale EP on 96 H100s
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Reproduced large-scale EP on 96 H100s — $0.20 per 1 million output tokens
Why it matters
An open-source reproduction of frontier-class MoE serving
Source — Primary sources first; secondary reports are labelled “Press”
Officiallmsys.orghttps://lmsys.org/blog/2025-05-05-large-scale-ep/Added in Week 35, 2026 · See that week
On the map — ⑧ Inference Infrastructure line
- Previous stopGemma 3 QAT int4
- This recordSGLang reproduces large-scale EP on 96 H100s
- Next stopDeepSeek-V3.2-Exp