Location: safety-case.md:17
Finding: The safety case's test-evidence line asserts "213/213 tests passed." Counting Test*/Fuzz* function definitions in the repository's _test.go files gives 169; running go test ./... -v gives 159 top-level PASS lines (376 if subtests are counted individually). None of these counting methods land on 213, so the figure in the safety case doesn't appear to be reproducible from the current tree by any obvious method, and is likely stale relative to an earlier snapshot of the codebase. (By contrast, the "94" requirement count on the same page does match .fusa-reqs.json, so this isn't a wholesale-fabrication concern — just this one figure.)
Recommendation: Regenerate the test-evidence count directly from the current suite as part of the safety-evidence pipeline, and document which counting method (top-level functions vs. all subtests) produces the published number so it stays auditable.
Filed from the 2026-07-29 ecosystem audit register; independently re-verified against current HEAD before filing.
Location:
safety-case.md:17Finding: The safety case's test-evidence line asserts "213/213 tests passed." Counting
Test*/Fuzz*function definitions in the repository's_test.gofiles gives 169; runninggo test ./... -vgives 159 top-level PASS lines (376 if subtests are counted individually). None of these counting methods land on 213, so the figure in the safety case doesn't appear to be reproducible from the current tree by any obvious method, and is likely stale relative to an earlier snapshot of the codebase. (By contrast, the "94" requirement count on the same page does match.fusa-reqs.json, so this isn't a wholesale-fabrication concern — just this one figure.)Recommendation: Regenerate the test-evidence count directly from the current suite as part of the safety-evidence pipeline, and document which counting method (top-level functions vs. all subtests) produces the published number so it stays auditable.
Filed from the 2026-07-29 ecosystem audit register; independently re-verified against current HEAD before filing.