feat(streaming): GPU-side routed-expert slot remap + residency shed - #22

feat(streaming): GPU-side routed-expert slot remap + residency shed#22

asher merged 2 commits into

mainasher/mlx-kquant:mainfrom

gpu-dispatchasher/mlx-kquant:gpu-dispatchCopy head branch name to clipboard