Draft: portable GGML GPU offload for Vulkan, Metal, and CUDA - #5

Draft

kenjorissen wants to merge 10 commits into

iafiscal1212:mainfrom

kenjorissen:integration/portable-gpu-offload

Commits on Aug 18, 2026

Repair C++ logit validation
kenjorissen
committed
7425994
Rank Dream candidates by normalized probability
kenjorissen
committed
43755b7
Preserve Dream logit sources in sparse cache
kenjorissen
committed
53f1a50
Use tokenizer metadata for mask removal
kenjorissen
committed
65dc545
feat: expose available GGML devices
kenjorissen
committed
6374274
feat: offload diffusion inference through GGML
kenjorissen
committed
8919abd
Offload cached diffusion inference
kenjorissen
committed
ec0b04d
Offload autoregressive and speculative inference
kenjorissen
committed
7c707de
test: add backend divergence diagnostics
kenjorissen
committed
fd7541d
Expose backend selection through Python tools
kenjorissen
committed
247386f