feat: add train-model and demonstrate-value skills, exponential backoff in babysit-training#6
Merged
lawwu merged 1 commit intoMar 15, 2026
Conversation
…ff in babysit-training Closes #2, #3, #5 - babysit-training: add exponential backoff (1.5x per uneventful poll, capped at --max-interval, reset on anomaly/loss spike/state change); new --max-interval and --no-backoff flags; show next-poll interval in progress output - train-model: new skill wrapping babysit-training for monitoring and check-failed-run for failure recovery; supports HP overrides, early stopping, and checkpoint management - demonstrate-value: new skill generating a stakeholder-ready HTML presentation via showboat from eval/explainability/baseline artifacts - orchestrate-e2e: gate 6 delegates to train-model; optional demonstrate-value step added after gate 8 - schemas.md/vocabulary.md: add train-model and demonstrate-value schemas, Terminal State enum - lifecycle-gates, artifact-contract, skill-matrix, modes: updated references for train-model at stage 6 - plugin.json: bump to 0.2.0
lawwu
deleted the
feat/issues-2-3-5-train-model-demonstrate-value-backoff
branch
March 15, 2026 04:46
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #2, #3, #5
Summary
babysit-training: adds--max-intervaland--no-backoffflags; interval grows 1.5× per uneventful poll (capped at--max-interval, default 300s) and resets on anomaly, >5% loss delta, new epoch, or Vertex AI state change; progress output now showsnext poll in Xstrain-modelskill: new action skill that parses and launches a training command, applies HP overrides, delegates monitoring tobabysit-training, enforces early stopping, tracks checkpoints, and invokescheck-failed-runon failure;orchestrate-e2egate 6 now callstrain-modelinstead of running training inlinedemonstrate-valueskill: new post-eval skill that readscheck-eval.json,explain-model.json, andbuild-baseline.json, translates metrics into business-language impact estimates, and renders a stakeholder-ready HTML presentation via showboat; added as an optional step inorchestrate-e2eafter gate 8Files changed
skills/babysit-training/SKILL.md— backoff logic, new flags, updated exampleskills/train-model/SKILL.md— new skillskills/demonstrate-value/SKILL.md— new skillskills/orchestrate-e2e/SKILL.md— gate 6 → train-model; optional demonstrate-value stepskills/orchestrate-e2e/references/lifecycle-gates.md— gate 6 evidence updatedskills/orchestrate-e2e/references/artifact-contract.md— gate numbering fixed; train-model.json and demonstrate-value artifacts addedskills/benchmark-e2e/references/skill-matrix.md+modes.md— stage 6 updated to train-modelreferences/schemas.md— train-model and demonstrate-value schemas; orchestrate-e2e gate_name enum updatedreferences/vocabulary.md— Terminal State enum addedREADME.md— train-model and demonstrate-value rows added (14 skills total)plugin.json— bumped to 0.2.0Test plan
claude --plugin-dir ./plugins/agentic-ml— verifytrain-modelanddemonstrate-valueappear in skill list/train-modelwith a toy training command and confirm it delegates tobabysit-training/babysit-trainingwith--interval 5 --max-interval 30on a long-running process and confirm interval grows and resets on anomaly/demonstrate-valuewith existingcheck-eval.jsonand confirm HTML is generated