Test and compare LLM prompts across providers — automated quality scoring, latency benchmarks, cost analysis. YAML-driven, works with any OpenAI-compatible API.
-
Updated
May 10, 2026 - Python
Test and compare LLM prompts across providers — automated quality scoring, latency benchmarks, cost analysis. YAML-driven, works with any OpenAI-compatible API.
OpenAI-compatible AI API gateway — 100+ models, smart routing, failover. Claude, GPT, Gemini, DeepSeek, Qwen, Mistral. Free $10 credit.
Benchmark OpenAI-compatible LLM APIs on latency, throughput, output quality, and 2026 pricing. Compare Claude, GPT, Gemini, DeepSeek, Qwen, and more with YAML-driven workloads.
Add a description, image, and links to the xidao topic page so that developers can more easily learn about it.
To associate your repository with the xidao topic, visit your repo's landing page and select "manage topics."