Skip to content

feat(cli): infer Vitest verifier eval commands - #1483

Merged
christso merged 1 commit into
mainfrom
feat/eval-verifier-dispatch
Jun 22, 2026
Merged

feat(cli): infer Vitest verifier eval commands#1483
christso merged 1 commit into
mainfrom
feat/eval-verifier-dispatch

Conversation

@christso

Copy link
Copy Markdown
Collaborator

Summary

  • infer the Vitest code-grader adapter for verifier-looking files passed to agentv eval
  • keep agentv eval vitest as the explicit adapter command for advanced flags
  • update docs, eval-writer guidance, and the Vitest workspace grader example to use the shorthand

Detection

  • *.test.ts/js/tsx/jsx and *.spec.ts/js/tsx/jsx
  • Vercel-style EVAL.ts/js/tsx/jsx
  • *.eval.ts and YAML eval files still route to normal eval run

Verification

  • bun test apps/cli/test/unit/preprocess-argv.test.ts
  • bun test apps/cli/test/commands/eval/vitest.test.ts
  • bun apps/cli/src/cli.ts eval examples/features/vitest-workspace-grader/evals/dataset.eval.yaml --target mock_agent
  • bun --filter @agentv/core build (to refresh dist after pulling current main)
  • bun --filter agentv test
  • bun --filter agentv typecheck
  • bun --filter agentv lint
  • bun --filter agentv build
  • bun run validate:examples

Tracker: av-bv4.20

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 0852d45
Status: ✅  Deploy successful!
Preview URL: https://3e4ebe92.agentv.pages.dev
Branch Preview URL: https://feat-eval-verifier-dispatch.agentv.pages.dev

View logs

@christso
christso merged commit 6c64ab5 into main Jun 22, 2026
8 checks passed
@christso
christso deleted the feat/eval-verifier-dispatch branch June 22, 2026 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant