Skip to content

docs: refresh validated Android and crash benchmarks - #463

Merged
janicduplessis merged 1 commit into
mainfrom
docs/benchmark-refresh-450
Sep 6, 2026
Merged

docs: refresh validated Android and crash benchmarks#463
janicduplessis merged 1 commit into
mainfrom
docs/benchmark-refresh-450

Conversation

@janicduplessis

Copy link
Copy Markdown
Collaborator

Description

Refresh the Android benchmark results after the compiler-cache fixes and add the completed Sol iOS launch-crash attempt. Nine of 16 Android attempts passed publication review; seven were excluded for setup, incomplete execution, or coordinator-path isolation violations. Crash control timed out, so there is no paired crash speedup claim.

Solution

Publish only validated runs, with sanitized command timelines, token/cost estimates, Settings screenshots, and recordings. Replace the previous Android data and remove obsolete proof assets. Keep missing cells disabled and explain cache preparation, fixed validation thresholds, and the excluded coverage in the methodology. Existing iOS readiness results are unchanged.

Crash data includes #462's audit correction; excluded attempts were retained locally without retries.

Test plan

  • Rechecked source evidence, screenshot/video integrity, device isolation, and native Stim cache hits before export; no machine-specific paths in the exported data.
  • Verified the production site in Safari: updated Android graph, missing cells, crash diagnosis 2m42s and repaired Settings 4m37s; inspect the linked run timelines and proof media.
  • Website typecheck and production build pass.

Fixes #450

@janicduplessis
janicduplessis marked this pull request as ready for review September 6, 2026 15:20
@janicduplessis
janicduplessis merged commit e62e6f7 into main Sep 6, 2026
5 checks passed
@janicduplessis
janicduplessis deleted the docs/benchmark-refresh-450 branch September 6, 2026 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Refresh Android and launch-recovery benchmark results after cache improvements

1 participant