Add Online-Mind2Web benchmark harness (packages/bench) - #39

Closed

pbjaru wants to merge 5 commits into

mainfrom

phani/cua-bench-runner

Commits on Jun 26, 2026

Add packages/bench with a single-task CUA model runner
pbjaru
committed
c7c3883
Add Online-Mind2Web benchmark harness to packages/bench
pbjaru
committed
6e4941a
Deslop: drop the superseded single-task spike
pbjaru
committed
aa03104
Don't persist result.json for failed bench runs

pbjaru
and
claude
committed
7934b6d
Cap benchmark retries and count permanent failures in accuracy

pbjaru
and
claude
committed
0cddee0