Skip to content

Clarify Agent0 evaluation scope and harden sandbox handoff - #1

Merged
noah-ing merged 1 commit into
mainfrom
cleanup/truthful-evaluation-2026-08
Aug 20, 2026
Merged

Clarify Agent0 evaluation scope and harden sandbox handoff#1
noah-ing merged 1 commit into
mainfrom
cleanup/truthful-evaluation-2026-08

Conversation

@noah-ing

Copy link
Copy Markdown
Owner

Summary

  • present this repository as an independent OpenCompass evaluation harness and separate historical endpoint scores from Agent0 training claims
  • tighten the SandFuzz handoff so child processes receive a small non-secret environment and add focused regression tests
  • remove unused vendored package debris and add Apache-2.0 licensing, security guidance, and pinned read-only CI

Verification

  • python3 -m unittest discover -s tests -v (3 passed)
  • python3 -m py_compile src/tools/python_sandbox.py scripts/generate_iteration_report.py
  • git diff --check

No hosted-model benchmark was rerun; doing so would incur API calls, and the README labels the checked-in scores as historical.

@noah-ing
noah-ing merged commit 2ca7be7 into main Aug 20, 2026
2 checks passed
@noah-ing
noah-ing deleted the cleanup/truthful-evaluation-2026-08 branch August 20, 2026 20:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant