Skip to content

fix(results): restore index jsonl artifact - #1569

Merged
christso merged 1 commit into
mainfrom
restore-index-jsonl
Jun 30, 2026
Merged

fix(results): restore index jsonl artifact#1569
christso merged 1 commit into
mainfrom
restore-index-jsonl

Conversation

@christso

@christso christso commented Jun 30, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • restore index.jsonl as the only canonical run row artifact name
  • remove the recent alternate filename compatibility path instead of carrying an alias
  • update results readers, docs, and tests around the summary.json aggregate vs index.jsonl row-index distinction
  • fix the full CLI package test expectation so it asserts the canonical root index.jsonl is written
  • speed up CI Validate Evals by reusing the Build job artifact instead of rebuilding packages in that job
  • update artifact upload/download actions to Node 24-based major versions

Validation

  • bun run build
  • bun test apps/cli/test/commands/eval/artifact-writer.test.ts -t "writes summary, index.jsonl, and per-run artifact files"
  • bun --filter agentv test passed locally: 735 tests
  • bun scripts/validate-eval-dirs.ts && bun apps/cli/dist/cli.js validate 'examples/features/**/evals/**/*.eval.yaml' 'examples/features/**/*.EVAL.yaml'
  • bun test apps/cli/test/commands/eval/result-layout.test.ts apps/cli/test/commands/eval/aggregate.test.ts apps/cli/test/commands/results/export.test.ts apps/cli/test/commands/compare/compare.test.ts apps/cli/test/commands/trend/trend.test.ts apps/cli/test/unit/retry-errors.test.ts packages/core/test/evaluation/results-repo.test.ts
  • bun run typecheck
  • bun run lint
  • bun --filter @agentv/core generate:schema exited 0 with existing recursive-reference warnings; generated output had no relevant artifact-name changes and was not kept
  • GitHub Actions CI is green on 1270e997; Validate Evals restored the Build artifact and completed in 18s
  • Live eval dogfood attempted with bun apps/cli/src/cli.ts eval examples/features/rubric/evals/dataset.eval.yaml --test-id summary-task; provider failed with pi-ai call failed: Connection error, but the emitted run wrote index.jsonl and no removed-name artifact.

Beads: av-wmw4, av-bcqv, av-iuu9, av-8ry5, av-hb10

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 30, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 1270e99
Status: ✅  Deploy successful!
Preview URL: https://0e328bd4.agentv.pages.dev
Branch Preview URL: https://restore-index-jsonl.agentv.pages.dev

View logs

@christso
christso force-pushed the restore-index-jsonl branch from 96d76ac to d5174b4 Compare June 30, 2026 00:23
@christso christso changed the title fix(results): restore index jsonl run manifest fix(results): restore index jsonl artifact Jun 30, 2026
@christso
christso force-pushed the restore-index-jsonl branch 2 times, most recently from a800a4a to 73cffca Compare June 30, 2026 01:10
@christso
christso force-pushed the restore-index-jsonl branch from 73cffca to 1270e99 Compare June 30, 2026 01:28
@christso
christso marked this pull request as ready for review June 30, 2026 01:41
@christso
christso merged commit 42867f9 into main Jun 30, 2026
8 checks passed
@christso
christso deleted the restore-index-jsonl branch June 30, 2026 01:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant