Inference Infrastructure & ServingSeoul National University (Gyeong-In Yu et al.)
Orca
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Orca — iteration-level scheduling
Why it matters
The prototype of continuous batching
Source — Primary sources first; secondary reports are labelled “Press”
Officialusenix.orghttps://www.usenix.org/conference/osdi22/presentation/yuAdded in Week 35, 2026 · See that week
On the map — ⑧ Inference Infrastructure line
- Previous stopThe line starts here
- This record · stopOrca
- Next stopSpeculative Decoding