Skip to content

Optimize INT4 MoE prefill/decode (sym) XPU kernels with dedicated w4a16 tiling - #2111

Draft
a32543254 with Copilot wants to merge 49 commits into
mainfrom
copilot/optimize-int4-moe-performance
Draft

Optimize INT4 MoE prefill/decode (sym) XPU kernels with dedicated w4a16 tiling#2111
a32543254 with Copilot wants to merge 49 commits into
mainfrom
copilot/optimize-int4-moe-performance

perf: raise the MoE auto-dispatch decode cutoff from 32 to 128 tokens

03ca877
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar