Project Request: inferbench

[JoniMartin27]

Project Information

• Project name: inferbench
• Github URL: https://github.com/JoniMartin27/inferbench
• Homepage URL: https://jonimartin27.github.io/inferbench
• Logo URL:

Category

• Inference
  • Inference Engine
  • Inference Platform
  • Middleware
  • LLM Router
  • AI Gateway
  • Output
  • Simulator
  • Benchmark
• Orchestration
  • Application Framework
  • Agent Framework
  • Evolutionary Framework
  • RAG
  • Workflow
• Runtime
  • AI Terminal
  • AI Agent
  • Chatbot
  • Code Agent
  • Database
  • Evolve Agent
  • Observation
  • Sandbox
  • Tool
• Training
  • Framework
  • FineTune
  • RLHF
  • Agentic RL
  • Benchmark
  • Workflow

---

inferbench is a local-first CLI to benchmark real inference speed (tokens/sec) of GGUF / llama.cpp models on your own hardware. It ships a 124-model catalog, bilingual (EN/ES) UI, SHA-256 verification of downloaded binaries, and an optional serve mode + MCP server. MIT licensed. Tested on consumer GPUs (e.g. RTX 3070).