Skip to content

perf(qwen3): skip redundant decode d2h/host copies in greedy path - #1

Open
lyfne123 wants to merge 5 commits into
chore/adapt-qwen3-decode-fwd-restorefrom
perf/qwen3-decode-skip-redundant-d2h
Open

perf(qwen3): skip redundant decode d2h/host copies in greedy path#1
lyfne123 wants to merge 5 commits into
chore/adapt-qwen3-decode-fwd-restorefrom
perf/qwen3-decode-skip-redundant-d2h

ci: re-trigger NPU unit-tests (chunked-prefill argmax flake, not a re…

94e8975
Select commit
Loading
Failed to load commit list.

There are no checks for this commit