Add nanoserve to Inference/Inference Engine

README.md

@@ -46,6 +46,7 @@
 * **[Cortex.cpp](https://github.com/janhq/cortex.cpp)**: Local AI API Platform. ![Stars](https://img.shields.io/github/stars/janhq/cortex.cpp.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/janhq/cortex.cpp?color=green) ![LastCommit](https://img.shields.io/github/last-commit/janhq/cortex.cpp?color=green)
 * **[DeepSpeed-MII](https://github.com/microsoft/DeepSpeed-MII)**: MII makes low-latency and high-throughput inference possible, powered by DeepSpeed. ![Stars](https://img.shields.io/github/stars/microsoft/deepspeed-mii.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/microsoft/deepspeed-mii?color=green) ![LastCommit](https://img.shields.io/github/last-commit/microsoft/deepspeed-mii?color=green)
 * **[llama-box](https://github.com/gpustack/llama-box)**: LM inference server implementation based on *.cpp. ![Stars](https://img.shields.io/github/stars/gpustack/llama-box.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/gpustack/llama-box?color=green) ![LastCommit](https://img.shields.io/github/last-commit/gpustack/llama-box?color=green)
+* **[nanoserve](https://github.com/pjdurden/nanoserve)**: An AI inference engine from scratch. Like nanoGPT, but for serving. ![Stars](https://img.shields.io/github/stars/pjdurden/nanoserve.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/pjdurden/nanoserve?color=green) ![LastCommit](https://img.shields.io/github/last-commit/pjdurden/nanoserve?color=green)
 * **[Nvidia Dynamo](https://github.com/ai-dynamo/dynamo)**: A Datacenter Scale Distributed Inference Serving Framework. ![Stars](https://img.shields.io/github/stars/ai-dynamo/dynamo.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/ai-dynamo/dynamo?color=green) ![LastCommit](https://img.shields.io/github/last-commit/ai-dynamo/dynamo?color=green)
 * **[ipex-llm](https://github.com/intel-analytics/ipex-llm)**: Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc. ![Stars](https://img.shields.io/github/stars/intel-analytics/ipex-llm.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/intel-analytics/ipex-llm?color=green) ![LastCommit](https://img.shields.io/github/last-commit/intel-analytics/ipex-llm?color=green)
 * **[LMDeploy](https://github.com/InternLM/lmdeploy)**: LMDeploy is a toolkit for compressing, deploying, and serving LLMs. ![Stars](https://img.shields.io/github/stars/internlm/lmdeploy.svg?style=flat&color=green) ![Contributors](https://img.shields.io/github/contributors/internlm/lmdeploy?color=green) ![LastCommit](https://img.shields.io/github/last-commit/internlm/lmdeploy?color=green)

website/data.yml

@@ -62,6 +62,11 @@ categories:
       homepage_url: https://mlserver.readthedocs.io/
       logo: mlserver.png
       repo_url: https://github.com/SeldonIO/MLServer
+    - name: nanoserve
+      description: An AI inference engine from scratch. Like nanoGPT, but for serving.
+      homepage_url: https://pjdurden.github.io/nanoserve/
+      logo: default.png
+      repo_url: https://github.com/pjdurden/nanoserve
     - name: Nvidia Dynamo
       description: A Datacenter Scale Distributed Inference Serving Framework.
       homepage_url: https://developer.nvidia.com/dynamo