Labels

• bug

  bug

  Something isn't working

• category:code

  category:code

  Code benchmark questions.

• category:comp

  category:comp

  Comprehensive benchmark questions.

• category:hallucination

  category:hallucination

  Hallucination control and instruction-following questions.

• category:logic

  category:logic

  Natural-language and logic benchmark questions.

• category:math

  category:math

  Math benchmark questions.

• ci

  ci

  Continuous integration, automation, and repository tooling.

• dependencies

  dependencies

  Pull requests that update a dependency file

• difficulty:advanced

  difficulty:advanced

  Advanced difficulty benchmark questions.

• difficulty:base

  difficulty:base

  Base difficulty benchmark questions.

• difficulty:final

  difficulty:final

  Final difficulty benchmark questions.

• difficulty:final+

  difficulty:final+

  Final-plus difficulty benchmark questions.

• documentation

  documentation

  Improvements or additions to documentation

• duplicate

  duplicate

  This issue or pull request already exists

• enhancement

  enhancement

  New feature or request

• github_actions

  github_actions

  Pull requests that update GitHub Actions code

• good first issue

  good first issue

  Good for newcomers

• help wanted

  help wanted

  Extra attention is needed

• invalid

  invalid

  This doesn't seem right

• needs-triage

  needs-triage

  Needs maintainer review and routing.

• provider

  provider

  LLM provider integrations and model configuration behavior.

• python

  python

  Pull requests that update python code

• question

  question

  Further information is requested

• question-bank

  question-bank

  Benchmark question additions, corrections, or metadata changes.

• runner

  runner

  CAC runner, scope resolution, judging, or reporting logic.

• security

  security

  Security, secrets, dependency vulnerabilities, or safe handling.

• validation

  validation

  Question validation, local checks, or quality gates.

• wontfix

  wontfix

  This will not be worked on