Skip to content

rigor-reviewer: Seal Level 3 remediation loop (triage + consent-gated auto-fix) - #5

Draft
ShokuhouMisak1 wants to merge 1 commit into
mainfrom
feat/rigor-reviewer-l3-remediation
Draft

rigor-reviewer: Seal Level 3 remediation loop (triage + consent-gated auto-fix)#5
ShokuhouMisak1 wants to merge 1 commit into
mainfrom
feat/rigor-reviewer-l3-remediation

Conversation

@ShokuhouMisak1

Copy link
Copy Markdown
Collaborator

What

Closes the ARA pipeline loop compile → record → review → fix by adding a Seal Level 3
remediation capability to rigor-reviewer, kept self-contained (no new standalone skill).

Changes (only skills/rigor-reviewer/)

  • Per-finding triage (review_version → 3.1.0): every Level 2 finding now carries
    fix_class ∈ {authoring-auto, data-derivable-auto, compute-bound-defer,
    external-defer, judgment-defer} and, for -auto findings, a structured fix_action
    (op / target / source_for_data / spec). This makes downstream remediation
    deterministic and fabrication-safe.
  • Step 8 — consent-gated fix: after the report is written, if ≥1 auto-fixable finding
    exists, the reviewer asks the user (via AskUserQuestion) whether to fix now. It never
    modifies the ARA without an explicit first-person "yes", and -defer findings always go to
    the human worklist. Zero auto-fixable findings → no prompt.
  • references/remediation.md — the Seal Level 3 contract the reviewer obeys strictly
    once authorized: the fabrication firewall (a fix may only re-express/relocate/scope/
    re-file existing knowledge — never invent a new empirical number; data-derivable-auto
    tables require a source_for_data), re-run Seal Level 1 after each round, anti-gaming (no
    score bump from self-remediation unless the epistemic ceiling actually moved), provenance,
    append-only journey, max 3 rounds.
  • references/seal1_check.py — portable Seal Level 1 structural validator to run after
    each remediation round.

Why internalized (not a separate skill)

Per design discussion: folding remediation into the reviewer's references keeps the reviewer
self-contained and makes the "fix strictly per the contract" constraint unambiguous, instead
of depending on a separate installed skill.

Validation

  • seal1_check.py runs clean (PASS 171 / FAIL 0) against a compiled ARA.
  • Step 8 + reference wiring verified; no dangling standalone-skill references.

🤖 Generated with Claude Code

- Add fix_class/fix_action triage to each Level 2 finding (review_version 3.1.0)
  so findings carry how-to-fix metadata (authoring-auto / data-derivable-auto /
  compute-bound-defer / external-defer / judgment-defer).
- Add Step 8: after writing the report, prompt the user (AskUserQuestion) whether
  to auto-fix the -auto findings; never modify the ARA without consent; -defer
  findings always go to the human worklist.
- Internalize remediation as references/remediation.md (the Seal Level 3 contract:
  fabrication firewall, re-seal after each round, anti-gaming, provenance) instead
  of a standalone skill; Step 8 obeys it strictly when authorized.
- Add references/seal1_check.py portable Seal Level 1 validator (run after each
  remediation round).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@AmberLJC
AmberLJC self-requested a review June 8, 2026 05:49
@AmberLJC

AmberLJC commented Jun 8, 2026

Copy link
Copy Markdown
Collaborator

Let's not go with a validator like seal1_check.py here — its checks are whole-file substring matches (not per-entity) and can't verify that data-derivable-auto numbers came from their cited source, so it gives a false sense of safety rather than real enforcement; can we deprioritize this skill for now?

@AmberLJC
AmberLJC marked this pull request as draft June 15, 2026 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants