Skip to content
This repository was archived by the owner on Jun 25, 2026. It is now read-only.

Add structured commissioner scores - #51

Open
KyleHerndon wants to merge 1 commit into
mainfrom
kyle/commissioner-structured-scores
Open

Add structured commissioner scores#51
KyleHerndon wants to merge 1 commit into
mainfrom
kyle/commissioner-structured-scores

Conversation

@KyleHerndon

Copy link
Copy Markdown
Contributor

Summary

  • Add a structured scores map to commissioner episode scores while preserving the legacy scalar score field.
  • Propagate structured score maps through the round-start adapter into local commissioner models.
  • Aggregate named score fields into ranking.result_metadata["scores"] at round completion so app_backend can publish multiple leaderboard score columns.

Validation

  • uv run python -m compileall commissioners tests — passed.
  • uv run pytest tests/test_commissioner_strategies.py -q — 71 passed.
  • git diff --check — passed.

Lint

  • No lint command is configured in pyproject.toml; the dev dependency group contains pytest/pytest-asyncio/httpx only.

Co-authored-by: GPT-5 Codex <codex@openai.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant