From 5919255d08d8bb78a0b536db113cc2fbc8f2ea5f Mon Sep 17 00:00:00 2001 From: InftyAI-Agent <143625840+InftyAI-Agent@users.noreply.github.com> Date: Sun, 21 Jun 2026 04:46:14 +0000 Subject: [PATCH] Add https://github.com/pjdurden/nanoserve to Inference/Inference Engine category Co-authored-by: pjdurden --- README.md | 1 + website/data.yml | 5 +++++ 2 files changed, 6 insertions(+) diff --git a/README.md b/README.md index 7cb261a..1a2c95c 100644 --- a/README.md +++ b/README.md @@ -46,6 +46,7 @@ * **[Cortex.cpp](https://github.com/janhq/cortex.cpp)**: Local AI API Platform. ![Stars](https://img.shields.io/github/stars/janhq/cortex.cpp.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/janhq/cortex.cpp?color=green) ![LastCommit](https://img.shields.io/github/last-commit/janhq/cortex.cpp?color=green) * **[DeepSpeed-MII](https://github.com/microsoft/DeepSpeed-MII)**: MII makes low-latency and high-throughput inference possible, powered by DeepSpeed. ![Stars](https://img.shields.io/github/stars/microsoft/deepspeed-mii.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/microsoft/deepspeed-mii?color=green) ![LastCommit](https://img.shields.io/github/last-commit/microsoft/deepspeed-mii?color=green) * **[llama-box](https://github.com/gpustack/llama-box)**: LM inference server implementation based on *.cpp. ![Stars](https://img.shields.io/github/stars/gpustack/llama-box.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/gpustack/llama-box?color=green) ![LastCommit](https://img.shields.io/github/last-commit/gpustack/llama-box?color=green) +* **[nanoserve](https://github.com/pjdurden/nanoserve)**: An AI inference engine from scratch. Like nanoGPT, but for serving. ![Stars](https://img.shields.io/github/stars/pjdurden/nanoserve.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/pjdurden/nanoserve?color=green) ![LastCommit](https://img.shields.io/github/last-commit/pjdurden/nanoserve?color=green) * **[Nvidia Dynamo](https://github.com/ai-dynamo/dynamo)**: A Datacenter Scale Distributed Inference Serving Framework. ![Stars](https://img.shields.io/github/stars/ai-dynamo/dynamo.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/ai-dynamo/dynamo?color=green) ![LastCommit](https://img.shields.io/github/last-commit/ai-dynamo/dynamo?color=green) * **[ipex-llm](https://github.com/intel-analytics/ipex-llm)**: Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc. ![Stars](https://img.shields.io/github/stars/intel-analytics/ipex-llm.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/intel-analytics/ipex-llm?color=green) ![LastCommit](https://img.shields.io/github/last-commit/intel-analytics/ipex-llm?color=green) * **[LMDeploy](https://github.com/InternLM/lmdeploy)**: LMDeploy is a toolkit for compressing, deploying, and serving LLMs. ![Stars](https://img.shields.io/github/stars/internlm/lmdeploy.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/internlm/lmdeploy?color=green) ![LastCommit](https://img.shields.io/github/last-commit/internlm/lmdeploy?color=green) diff --git a/website/data.yml b/website/data.yml index 0e3cf5a..602fa0a 100644 --- a/website/data.yml +++ b/website/data.yml @@ -62,6 +62,11 @@ categories: homepage_url: https://mlserver.readthedocs.io/ logo: mlserver.png repo_url: https://github.com/SeldonIO/MLServer + - name: nanoserve + description: An AI inference engine from scratch. Like nanoGPT, but for serving. + homepage_url: https://pjdurden.github.io/nanoserve/ + logo: default.png + repo_url: https://github.com/pjdurden/nanoserve - name: Nvidia Dynamo description: A Datacenter Scale Distributed Inference Serving Framework. homepage_url: https://developer.nvidia.com/dynamo