-
Notifications
You must be signed in to change notification settings - Fork 4
All issues
Issue creation is restricted in this repository
- #20 · MSKazemi opened
on Aug 8, 2026
Issues
is:issue state:open
is:issue state:open
Search results
mypy --strict: pay down
reports/+leaderboard/(17 errors)area: reportingReports, leaderboard, scorecardsReports, leaderboard, scorecardseffort: mediumRoughly a dayRoughly a dayhelp wantedExtra attention is neededExtra attention is neededtype: tech-debtCleanup, typing, lint, flaky testsCleanup, typing, lint, flaky testsStatus: Open.mypy --strict: pay down
judge/(19 errors)area: scorersScoring dimensions and scorersScoring dimensions and scorerseffort: mediumRoughly a dayRoughly a dayhelp wantedExtra attention is neededExtra attention is neededtype: tech-debtCleanup, typing, lint, flaky testsCleanup, typing, lint, flaky testsStatus: Open.mypy --strict: pay down
cli/(17 errors)area: cliCommand-line interfaceCommand-line interfaceeffort: mediumRoughly a dayRoughly a daygood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededtype: tech-debtCleanup, typing, lint, flaky testsCleanup, typing, lint, flaky testsStatus: Open.mypy --strict: pay down
scorers/(27 errors)area: scorersScoring dimensions and scorersScoring dimensions and scorerseffort: mediumRoughly a dayRoughly a dayhelp wantedExtra attention is neededExtra attention is neededtype: tech-debtCleanup, typing, lint, flaky testsCleanup, typing, lint, flaky testsStatus: Open.AWS Bedrock adapter
area: adaptersModel/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)Model/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)effort: mediumRoughly a dayRoughly a dayenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.Google Gemini adapter
area: adaptersModel/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)Model/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)effort: mediumRoughly a dayRoughly a dayenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.LiteLLM adapter — one file, ~100 providers
area: adaptersModel/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)Model/agent adapters (OpenAI, LiteLLM, Gemini, Bedrock, MCP)effort: mediumRoughly a dayRoughly a dayenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.Write "Your first 10 minutes with AOBench" — one path, no branching
area: docsDocumentation and examplesDocumentation and examplesdocumentationImprovements or additions to documentationImprovements or additions to documentationeffort: smallA few hours — good place to startA few hours — good place to startgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.Run a model and submit a leaderboard entry — negative results welcome
area: reportingReports, leaderboard, scorecardsReports, leaderboard, scorecardseffort: smallA few hours — good place to startA few hours — good place to startgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.Write a second task for a thin QCAT × role cell (32 of 50 have only one)
area: benchmarkTasks, environments, snapshotsTasks, environments, snapshotseffort: mediumRoughly a dayRoughly a daygood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.Triage the 96 CodeQL findings — path injection on the server surfaces first
area: infraBuild, CI, packaging, deploymentBuild, CI, packaging, deploymenteffort: mediumRoughly a dayRoughly a dayhelp wantedExtra attention is neededExtra attention is neededtype: tech-debtCleanup, typing, lint, flaky testsCleanup, typing, lint, flaky testsStatus: Open.Start here — where to contribute
documentationImprovements or additions to documentationImprovements or additions to documentationhelp wantedExtra attention is neededExtra attention is neededStatus: Open.#20 In MSKazemi/aobench;