feat: redesign evaluator core in Python - #1

Merged

jon-devlapaz merged 22 commits into

mainfrom

python-core-redesign

Aug 16, 2026

Commits on Aug 15, 2026

docs: add Python core redesign prompt
jon-devlapaz
committed
a42b5aa
feat: replace evaluator core with python skill
jon-devlapaz
committed
9a18478
feat: lock structured rubric tasks
jon-devlapaz
committed
d685d9b
feat: add provisional Codex rubric judge

jon-devlapaz
and
cursoragent
committed
96fd1d0
docs: describe provisional rubric judging

jon-devlapaz
and
cursoragent
committed
116bd3c
docs: record provisional judge decision

jon-devlapaz
and
cursoragent
committed
50a9d8c
docs: lock run-local Codex home isolation

jon-devlapaz
and
cursoragent
committed
c296e90
feat: isolate live Codex home from the host

jon-devlapaz
and
cursoragent
committed
6a0324c
docs: describe run-local Codex home

jon-devlapaz
and
cursoragent
committed
8782fa0
feat: add blinded pairwise rubric comparison

jon-devlapaz
and
cursoragent
committed
9f5c3ac
docs: describe blinded pairwise judging

jon-devlapaz
and
cursoragent
committed
c0d981a
feat: make reports and exit status quality-aware

jon-devlapaz
and
cursoragent
committed
5470e57
docs: describe quality-aware reports and exit codes

jon-devlapaz
and
cursoragent
committed
a121abe
feat: add human-labeled pairwise calibration

jon-devlapaz
and
cursoragent
committed
494aa0f
docs: describe pairwise judge calibration

jon-devlapaz
and
cursoragent
committed
93da333
fix: treat missing Codex model identity as unattested

jon-devlapaz
and
cursoragent
committed
29a89a2
docs: record live calibrate and unattested model identity

jon-devlapaz
and
cursoragent
committed
f448459
docs: hand off the Karpathy hill-climb as Phase 2

jon-devlapaz
and
cursoragent
committed
b83b928

Navigation Menu

feat: redesign evaluator core in Python - #1

feat: redesign evaluator core in Python#1
jon-devlapaz merged 22 commits into
mainfrom
python-core-redesign

Commits on Aug 15, 2026

docs: add Python core redesign prompt

feat: replace evaluator core with python skill

feat: lock structured rubric tasks

feat: add provisional Codex rubric judge

docs: describe provisional rubric judging

docs: record provisional judge decision

docs: lock run-local Codex home isolation

feat: isolate live Codex home from the host

docs: describe run-local Codex home

feat: add blinded pairwise rubric comparison

docs: describe blinded pairwise judging

feat: make reports and exit status quality-aware

docs: describe quality-aware reports and exit codes

feat: add human-labeled pairwise calibration

docs: describe pairwise judge calibration

fix: treat missing Codex model identity as unattested

docs: record live calibrate and unattested model identity

docs: hand off the Karpathy hill-climb as Phase 2

Commits on Aug 16, 2026

feat: bind accepted calibration into rubric runs

docs: document calibration-bound rubric runs

ci: fix setup-python action pin

fix: discard copied auth on initialization failure