Skip to content

docs(examples): clarify scenarios matrix use case - #1698

Merged
christso merged 2 commits into
mainfrom
docs/av-2inz-scenario-matrix
Jul 6, 2026
Merged

docs(examples): clarify scenarios matrix use case#1698
christso merged 2 commits into
mainfrom
docs/av-2inz-scenario-matrix

Conversation

@christso

@christso christso commented Jul 6, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • revise the scenarios feature example to demonstrate one shared test set crossed with multiple language config rows
  • update scenario docs/README so the use case is visually clear and not just a parser smoke test
  • add durable AGENTS/.agents verification guidance that feature dogfood must prove the real use case
  • fix the CLI terminal summary count exposed by the scenario matrix dogfood run

Validation

  • bun apps/cli/src/cli.ts validate examples/features/scenarios/evals/suite.yaml
  • bun apps/cli/src/cli.ts eval run examples/features/scenarios/evals/suite.yaml --targets examples/features/scenarios/targets.yaml --target translation-cli --output /tmp/agentv-scenarios-matrix-fixed-BpmNJV
    • printed RESULT: PASS (6/6 scored >= 80%) and Total tests: 6
  • bun run validate:examples
  • bun test apps/cli/test/commands/eval/aggregate.test.ts
  • bun run lint
  • bun run build
  • git diff --check

Closes av-2inz
Closes av-bins

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: ea2cb75
Status: ✅  Deploy successful!
Preview URL: https://3937bb61.agentv.pages.dev
Branch Preview URL: https://.agentv.pages.dev

View logs

@christso
christso merged commit 78c4d81 into main Jul 6, 2026
8 checks passed
@christso
christso deleted the docs/av-2inz-scenario-matrix branch July 6, 2026 09:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant