Wire consensus panel into engine, add verified execution and evaluation

[Kendiukhov]

Summary

Makes the consensus reviewer a live part of the execution loop (previously it existed only as an unused module), adds sandboxed verified execution, and adds a quantitative evaluation of the orchestrator. The PLOS ONE manuscript is updated to match.

Orchestration

• dsl: compile_loop now compiles a consensus_merger node into one consensus step carrying the full reviewer panel, instead of following only the first always edge and silently dropping the other reviewers. Linear loops compile unchanged.
• engine: runs the panel concurrently (asyncio.gather), accounts panel tokens/cost, formats merged feedback, and supports an optional advancement gate (blocks convergence while a Critical critique is unresolved). on_flag: edges are now honored from run config.
• consensus: configurable panel and agreement threshold, deterministic tie-break, optional per-role weighting, and a compute_consensus_report.

Verified execution

• code_executor: extracts fenced Python from executor artifacts and runs each block in an isolated python -I subprocess (fresh tempdir, wall-clock timeout, output cap). Opt-in via code_execution_enabled; the engine folds the execution report into feedback so reviewers critique executed results.

Mock adapter

• Role-authoritative detection from the prompt's role variable (fixes a latent misdetection of the executor prompt as idea_generator), differentiated per-lens critique sets with controlled overlap, fixed-iteration determinism, and a runnable snippet in the default executor output.

Evaluation

• analysis/experiments.py + scripts/: panel-size ablation, reviewer-lens overlap, convergence profile, concurrent-run load benchmark; figure/results generators; and a live-Gemini consensus corroboration probe.

Paper

• paper/plos/: PLOS ONE manuscript, figures, results data, and cover letter.

Tests

• Adds test_consensus_wiring.py, test_code_executor.py, test_experiments.py (17 tests). Full suite green: 358 passing (1 pre-existing unrelated asyncio.get_event_loop test deselected).

🤖 Generated with Claude Code