Skip to content

fix(schema): reject authored eval YAML workers - #1578

Merged
christso merged 3 commits into
mainfrom
christso/remove-authored-workers-yaml
Jun 30, 2026
Merged

fix(schema): reject authored eval YAML workers#1578
christso merged 3 commits into
mainfrom
christso/remove-authored-workers-yaml

Conversation

@christso

Copy link
Copy Markdown
Collaborator

Summary

Eval files can no longer author concurrency through workers; concurrency is now explicitly an operator/run setting from --workers, project config defaults, or target/provider caps. This keeps eval YAML focused on task definition, target binding, and policy while preserving the existing runtime worker execution path.

The parser, validator, schema, SDK YAML authoring helpers, TS eval materialization, and eval bundle generation now reject or stop emitting authored workers. Examples and docs now point users toward CLI/config concurrency instead of embedding worker counts in eval files.

Validation

  • bun install
  • bun --filter @agentv/core build && bun --filter @agentv/sdk build
  • bun --filter agentv build
  • bun test packages/core/test/evaluation/experiment.test.ts packages/core/test/evaluation/eval-inline-experiment.test.ts packages/core/test/evaluation/loaders/config-loader.test.ts packages/core/test/evaluation/loaders/ts-eval-loader.test.ts packages/core/test/evaluation/validation/eval-validator.test.ts
  • bun test packages/core/test/evaluation/validation/eval-file-schema.test.ts
  • bun test packages/sdk/test/eval-authoring.test.ts
  • bun test apps/cli/test/eval.integration.test.ts apps/cli/test/commands/eval/vscode-worker-limit.test.ts apps/cli/test/commands/eval/bundle.test.ts
  • bun run validate:examples
  • Targeted bunx biome check on modified TypeScript files

Not run: full bun run verify; live provider dogfood.


Compound Engineering
GPT--5_Codex

@christso
christso marked this pull request as ready for review June 30, 2026 10:43
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 30, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: a90048c
Status: ✅  Deploy successful!
Preview URL: https://c95b0ba1.agentv.pages.dev
Branch Preview URL: https://christso-remove-authored-wor.agentv.pages.dev

View logs

@christso
christso merged commit c062205 into main Jun 30, 2026
8 checks passed
@christso
christso deleted the christso/remove-authored-workers-yaml branch June 30, 2026 11:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant