feat(sdpa): starts + q8-KV operands for batched decode; env-gated small-M qmm kernels - #23

Merged

asher merged 10 commits into

mainfrom

Jul 30, 2026

Commits on Jul 30, 2026

feat(sdpa): per-row key start offsets for batched left-padded decode
asher
committed
4241aef
feat(matmul): env-gated split-k qmm_t dispatch + partial-fold accum kernel
asher
committed
e1ac45c
feat(matmul): mv_ext sb + x16/x32 experiment kernels (env-gated, measured losers on m5)
asher
committed
52de603
feat(matmul): env-gated nax split-k qmm_t dispatch (bm32 tile, k-slice partials)
asher
committed
d8f19c7
feat(matmul): mv_ext hd t-precision-dot experiment kernel (env-gated, +4-5% m8 only)
asher
committed
cc09993
feat(sdpa): fused q8-kv operands for sdpa_decode_gqa (affine wire dequant on tile stage)
asher
committed
8aa60a5
perf(sdpa): vectorize q8 kv stage to uint4 units with hoisted scales
asher
committed
a963885
changelog: smallm-splitk entries under unreleased
asher
committed
73d503c
tests: skip bf16 bk256 dsa cases on paravirtual metal (transient backend-compile flake)
asher
committed
2ba9a92
tests: prime the bk256 dsa pipeline with retries on paravirtual metal (covers the forced non-split route)
asher
committed
d981c30