halofpx

Here is 1 public repository matching this topic...

HaloFPX: High-Throughput Unified Model Server & Zoo for AMD Strix Halo (iGPU + NPU, 64GB-128GB) & Radeon GPUs

vulkan lemonade rocm model-server fastapi llama-cpp gguf speculative-decoding fp4 strix-halo amd-ryzen-ai halofpx

Add a description, image, and links to the halofpx topic page so that developers can more easily learn about it.

To associate your repository with the halofpx topic, visit your repo's landing page and select "manage topics."