Skip to content

Harden computer use runtime and CLI#4705

Open
Jinwoo-H wants to merge 1 commit into
mainfrom
Jinwoo-H/computer-use-investigation
Open

Harden computer use runtime and CLI#4705
Jinwoo-H wants to merge 1 commit into
mainfrom
Jinwoo-H/computer-use-investigation

Conversation

@Jinwoo-H
Copy link
Copy Markdown
Contributor

@Jinwoo-H Jinwoo-H commented Jun 5, 2026

Summary

  • Harden computer-use CLI and RPC contracts with stricter action validation, structured recovery guidance, and safer screenshot output handling
  • Improve provider lifecycle handling, socket/sidecar recovery, and native macOS/Linux/Windows runtime safeguards
  • Expand computer-use smoke, native verification, workflow guardrails, and desktop E2E coverage

Testing

  • pnpm vitest run src/cli/format.test.ts src/cli/handlers/computer.test.ts src/cli/handlers/computer-action-routing.test.ts src/cli/handlers/computer-action-validation.test.ts src/cli/handlers/computer-state-formatting.test.ts src/cli/index.test.ts src/cli/runtime/envelope-schema.test.ts src/cli/specs/computer.test.ts src/main/computer/desktop-script-provider-client.test.ts src/main/computer/desktop-script-provider-actions.test.ts src/main/computer/desktop-script-provider-action-errors.test.ts src/main/computer/desktop-script-provider-cache.test.ts src/main/computer/desktop-script-provider-cache-lifecycle.test.ts src/main/computer/desktop-script-provider-errors.test.ts src/main/computer/macos-computer-use-permissions.test.ts src/main/computer/macos-computer-use-permission-status.test.ts src/main/computer/macos-native-provider-client.test.ts src/main/computer/macos-native-provider-socket.test.ts src/main/computer/computer-provider-lifecycle.test.ts src/main/computer/computer-provider-unavailable-message.test.ts src/main/computer/sidecar-client.test.ts src/main/runtime/rpc/dispatcher-computer-errors.test.ts src/main/runtime/rpc/errors.test.ts src/main/runtime/rpc/methods/computer.test.ts src/main/runtime/rpc/methods/computer-actions.test.ts src/shared/computer-use-error-recovery.test.ts src/shared/computer-use-key-spec.test.ts src/shared/remote-runtime-client.test.ts config/scripts/computer-e2e-workflow.test.mjs config/scripts/computer-use-skill-guidance.test.mjs config/scripts/computer-use-smoke.test.mjs
  • pnpm run typecheck:node
  • pnpm run typecheck:cli
  • pnpm run verify:computer-native
  • pnpm build:cli
  • pnpm build:electron-vite
  • ORCA_COMPUTER_E2E=1 pnpm test:e2e:computer --reporter=verbose tests/e2e/computer-mac.e2e.ts tests/e2e/computer-mac-safari.e2e.ts
  • git diff --check

@Jinwoo-H Jinwoo-H force-pushed the Jinwoo-H/computer-use-investigation branch 7 times, most recently from 8815262 to da531b7 Compare June 5, 2026 18:42
Co-authored-by: Orca <help@stably.ai>
@Jinwoo-H Jinwoo-H force-pushed the Jinwoo-H/computer-use-investigation branch from da531b7 to 65b4145 Compare June 5, 2026 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant