stream: fix miss-shed crash under split prefill (k3), add shed-aware lookahead - #29

Merged

asher merged 10 commits into

mainfrom

k3-miss-shed-fix

Aug 6, 2026

Commits on Aug 4, 2026

loader: miss-shed skips arena token-split leaves (kimi-k3 prefill crash)
asher
committed
2e38418

Commits on Aug 5, 2026

feat(stream): clear-mode miss-shed and mass-weighted arena popularity
asher
committed
3f5b2a1
feat(stream): keeper-targeted lookahead prestage rides the miss-shed policy
asher
committed
ecd0aa5
refactor(stream): drop clear-mode miss-shed; tail sheds strictly more at any budget
asher
committed
51ac435
refactor(stream): drop mass-weighted popularity (isolation A/B was a wash)
asher
committed
27d9169
fix(run): over-generation verbose stream renders thinking like the main path
asher
committed
918ee69
feat(serve): moe_prestage config key + serve flag route keeper prestage per model
asher
committed
8c5626b

Commits on Aug 6, 2026