Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 7 additions & 3 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -188,12 +188,16 @@ <h2>Benchmark</h2>
<tr><td>docx</td><td>file_transform</td><td class="pill warn">92 / A</td><td>599 lines &amp; ~5142 tokens (over budget)</td></tr>
</table>
<h3 style="color:var(--white);font-size:19px;margin:28px 0 4px">The upgrade: score → fix → re-score</h3>
<p class="lead" style="margin:0 0 14px">skval doesn't just grade — its ranked findings drive the fix. The biggest real-world turnarounds:</p>
<p class="lead" style="margin:0 0 14px">skval doesn't just grade — its ranked findings drive the fix. Real published skills, scored verbatim then fixed and re-scored to a clean 100 — turnarounds up to <b class="A">+62</b>, Reject → Ship:</p>
<div class="grid2">
<div class="card"><h3><a href="https://github.com/glebis/claude-skills">daydream</a> · no frontmatter · <span class="warn">38</span> → <span class="A">100</span></h3>
<p style="color:var(--dim);margin:0">A real published skill (glebis/claude-skills) shipped with <em>no YAML frontmatter</em> — no name, no description, so it can't trigger. Add the frontmatter block: <code>compare.py</code> <b class="A">+62</b>, Reject → Ship. <a href="https://github.com/DCCA/skval/blob/main/docs/examples/skill-benchmark/from-the-web.md">case study →</a></p></div>
<div class="card"><h3><a href="https://github.com/glebis/claude-skills">annotate</a> · invalid frontmatter · <span class="warn">50</span> → <span class="A">100</span></h3>
<p style="color:var(--dim);margin:0">A real published skill (glebis/claude-skills) whose unquoted colon broke its YAML — it used to <em>crash</em> skval, and now scores. One-line fix: quote the description. <code>compare.py</code>: <b class="A">+50</b>, Revise → Ship. <a href="https://github.com/DCCA/skval/blob/main/docs/examples/skill-benchmark/from-the-web.md">case study →</a></p></div>
<p style="color:var(--dim);margin:0">An unquoted colon broke its YAML — it used to <em>crash</em> skval, and now scores. One-line fix: quote the description. <code>compare.py</code> <b class="A">+50</b>, Revise → Ship. <a href="https://github.com/DCCA/skval/blob/main/docs/examples/skill-benchmark/from-the-web.md">case study →</a></p></div>
<div class="card"><h3>bad-skill · <span class="warn">73</span> → <span class="A">100</span></h3>
<p style="color:var(--dim);margin:0">Four findings fixed one-for-one — kebab name, drop <code>&lt;&gt;</code>, broken ref, stray key. <code>compare.py</code>: <b class="A">+27</b>, Revise → Ship. <a href="https://github.com/DCCA/skval/tree/main/docs/examples/skill-benchmark/improved">case study →</a></p></div>
<p style="color:var(--dim);margin:0">Four findings fixed one-for-one — kebab name, drop <code>&lt;&gt;</code>, broken ref, stray key. <code>compare.py</code> <b class="A">+27</b>, Revise → Ship. <a href="https://github.com/DCCA/skval/tree/main/docs/examples/skill-benchmark/improved">case study →</a></p></div>
<div class="card"><h3><a href="https://github.com/glebis/claude-skills">rehydrate</a> · <code>&lt;&gt;</code> in description · <span class="warn">92</span> → <span class="A">100</span></h3>
<p style="color:var(--dim);margin:0">Angle brackets in the <code>description</code> break parsers and triggering — drop them to score clean. <code>compare.py</code> <b class="A">+8</b>. <a href="https://github.com/DCCA/skval/blob/main/docs/examples/skill-benchmark/from-the-web.md">case study →</a></p></div>
</div>
</section>

Expand Down
Loading