Summary
The postmortem and CLAUDE.md define the most important regression as: go offline in DevTools and run every tool — every metric must read — with a reason. A number appearing anywhere is a P0.
That check is currently manual. The suite has strong unit coverage for pure logic (rules engine, bottleneck, CSV, CIDR, OUI), but no automated guard that the full UI surface never fabricates a value when measurements fail.
Details
- Add a Playwright (or equivalent) test that loads the built app, forces offline, exercises each tool, and asserts no numeric output appears without a typed failure reason.
- Keep the existing unit tests; this is the browser-level complement they cannot reach.
- Document the command in CLAUDE.md next to the existing offline guidance.
Skill reference
Code-reviews skill: correctness first for a tool whose entire value is honest failure reporting. The fabrication bug shipped because failure paths were invisible in normal use.
GrokLuddite gen AI on behalf of TechLuddite
Summary
The postmortem and CLAUDE.md define the most important regression as: go offline in DevTools and run every tool — every metric must read
—with a reason. A number appearing anywhere is a P0.That check is currently manual. The suite has strong unit coverage for pure logic (rules engine, bottleneck, CSV, CIDR, OUI), but no automated guard that the full UI surface never fabricates a value when measurements fail.
Details
Skill reference
Code-reviews skill: correctness first for a tool whose entire value is honest failure reporting. The fabrication bug shipped because failure paths were invisible in normal use.
GrokLuddite gen AI on behalf of TechLuddite