Skip to content

Add verification test suite and fix docs#2

Open
ashley-ha wants to merge 1 commit into
mainfrom
test/verify-flow
Open

Add verification test suite and fix docs#2
ashley-ha wants to merge 1 commit into
mainfrom
test/verify-flow

Conversation

@ashley-ha

Copy link
Copy Markdown
Member

Summary

  • Add tests/verify-flow.sh — 53 integration tests covering the entire setup and browser control flow, runnable locally with Chrome + Ever extension
  • Fix SKILL.md — remove nonexistent --dir flag for ever screenshot, correct default save location
  • Fix install.sh — skip npm install -g @ever/cli when CLI is already installed (prevents hard failure since package isn't on npm yet)

Test Results

Passed: 50 | Failed: 3 | Skipped: 0

What's covered

Area Tests Status
Preflight CLI on PATH, version check
install.sh --help, SKIP_STAR_PROMPT, EVER_SKILLS_SKIP_STAR_PROMPT, non-TTY gate
npx skills add --list, install to .claude/skills/, file verification, skills list
SKILL.md structure Frontmatter, sections (Quick Start, Core Workflow, Commands Reference, Error Recovery)
Recipe validation File exists, header comment, INIT/COLLECT/DUMP pattern
GitHub release Release exists, Chrome extension zip asset present
Browser lifecycle start, snapshot, click, scroll, extract, eval (IIFE pattern), input, send-keys, go-back, navigate, search, sessions, tabs, doctor, screenshot, stop ✅ (50/53)

Known failures (upstream CLI bugs)

Issue Severity Details
@ever/cli not on npm Critical npm install -g @ever/cli returns 404. New users can't install via README or install script. install.sh now skips if already installed.
ever screenshot doesn't write files Medium CLI reports "Screenshot saved to ..." but no file is created on disk
ever tabs shows undefined tab ID Low Tab ID renders as undefined instead of a number

Test plan

  • Run bash tests/verify-flow.sh with Chrome + Ever extension active
  • Verify install.sh --skip-star-prompt skips npm install when CLI exists
  • Verify SKILL.md no longer references --dir flag

🤖 Generated with Claude Code

Add tests/verify-flow.sh with 53 tests covering the full setup and
browser control flow: install.sh gates, npx skills add, SKILL.md
structure, GitHub release assets, and all core ever CLI commands
(snapshot, click, scroll, extract, eval, input, send-keys, navigate,
go-back, search, tabs, sessions, doctor, screenshot, stop).

Fix SKILL.md: remove nonexistent --dir flag for screenshot, correct
default save location from "current directory" to "temp directory".

Fix install.sh: skip npm install when ever CLI is already installed,
preventing a hard failure since @ever/cli is not yet on the npm
registry.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant