Skip to content

fix(ci): point report test + smoke-test at committed probe fixture - #9

Merged
jlgore merged 1 commit into
mainfrom
fix/ci-harness-results-fixture
Jun 28, 2026
Merged

fix(ci): point report test + smoke-test at committed probe fixture#9
jlgore merged 1 commit into
mainfrom
fix/ci-harness-results-fixture

Conversation

@jlgore

@jlgore jlgore commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Problem

CI run 28326225090 failed on all three jobs (test node 18/20 + build & smoke-test).

Root cause: the report test and the CLI smoke-test load harness probe data from packages/harness/results, which is gitignored (results/ rule in packages/harness/.gitignore) and therefore absent in CI. loadHarnessProbes' statSync threw ENOENT.

Error: ENOENT: no such file or directory, stat '.../packages/harness/results'
 ❯ loadHarnessProbes src/report/matrix.ts:108
 ❯ test/report.test.ts:93

Fix

  • Add a small frozen fixture: packages/cli/test/fixtures/probes/ (2 files, real-shaped probe records).
  • Point report.test.ts and the smoke-test step at it instead of the gitignored live results dir.

Decouples CI from volatile live probe output and keeps live deployment hostnames out of the repo. Verified locally: vitest run test/report.test.ts passes (8/8) and the built-binary smoke-test commands exit 0.

Not in scope

Publishing the real packages/harness/results as reproducibility artifacts is a separate decision — it would need a scrub pass to placeholder live hostnames (sharted.workers.dev, callback.wulf.shart.cloud) before going public.

🤖 Generated with Claude Code

The report test and the CLI smoke-test loaded harness probe data from
packages/harness/results, which is gitignored (results/ rule) and so
absent in CI — loadHarnessProbes' statSync threw ENOENT, failing both
the test job and build & smoke-test.

Add a small frozen fixture (packages/cli/test/fixtures/probes/) and point
both at it. Decouples CI from volatile live probe output and keeps live
deployment hostnames out of the repo.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@jlgore
jlgore merged commit f224c66 into main Jun 28, 2026
3 checks passed
@jlgore
jlgore deleted the fix/ci-harness-results-fixture branch June 28, 2026 20:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant