mi355x

TokenSpeed is a speed-of-light LLM inference engine.

A from-scratch Rust inference stack for AMD GPUs that talks straight to the Linux kernel driver. No ROCm, HIP, or HSA runtime. Serves OLMo 2 on MI355X.

ATOM + NVIDIA Dynamo integration and upstream NIXL/MORI transport findings for AMD MI355X

Kimi-Linear long-context FP8 benchmark tooling for vLLM on AMD MI355X (AITER MLA head-padding + patched decode/prefill kernels).

Run LLM inference directly on AMD GPUs by bypassing ROCm for low-latency serving.