FastAPI LLM pool for local and OpenAI-compatible remote inference, with multimodal input, scheduling, replicas, metrics, and admin APIs.
-
Updated
Sep 1, 2026 - Python
#
vision-mtp
Here is 1 public repository matching this topic...
Add this topic to your repo
To associate your repository with the vision-mtp topic, visit your repo's landing page and select "manage topics."