Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2,974 changes: 1,204 additions & 1,770 deletions website/src/data/benchmarks/luna-android.json

Large diffs are not rendered by default.

1,857 changes: 281 additions & 1,576 deletions website/src/data/benchmarks/opus-android.json

Large diffs are not rendered by default.

1,771 changes: 643 additions & 1,128 deletions website/src/data/benchmarks/sol-android.json

Large diffs are not rendered by default.

897 changes: 189 additions & 708 deletions website/src/data/benchmarks/sol-launch-crash.json

Large diffs are not rendered by default.

1,987 changes: 176 additions & 1,811 deletions website/src/data/benchmarks/sonnet-android.json

Large diffs are not rendered by default.

30 changes: 29 additions & 1 deletion website/src/pages/benchmarks.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -206,13 +206,41 @@ export default function Benchmarks(): ReactNode {
<dt>Proof, not process liveness</dt>
<dd>The reported time is the validated Settings screenshot, not the earlier app-process marker.</dd>
</div>
<div>
<dt>Prepared caches</dt>
<dd>
Installed dependencies and cache preparation are outside the timer. Android runs start from clean
generated native state, with a seeded Stim APK and compiler cache and shared warmed Gradle caches.
Both Android arms create their worktree and device inside the timer.
</dd>
</div>
<div>
<dt>Launch-failure suite</dt>
<dd>Diagnosis time and repaired Settings proof are reported separately from readiness results.</dd>
</div>
<div>
<dt>Audited attempts</dt>
<dd>Transcript rules, device identity, isolation, and proof are checked; invalid runs are excluded.</dd>
<dd>
Transcript rules, device identity, isolation, and proof are checked; invalid runs are excluded, not
retried simply for a better result. Android native Stim runs also require verified compiler-cache
reuse against a fixed threshold established before dispatch.
</dd>
</div>
<div>
<dt>Current Android coverage</dt>
<dd>
Nine of 16 attempts passed publication review. Seven were excluded for setup, completion, or
coordinator-path isolation violations. Missing cells stay disabled; they are not zero-time results or
evidence of a performance win.
</dd>
</div>
<div>
<dt>Current crash coverage</dt>
<dd>
Sol completed the iOS Stim repair with recorded Settings proof. Control reached the 20-minute limit
before completing the recording protocol and is excluded. This is one valid attempt, not a paired
speedup comparison.
</dd>
</div>
</dl>
</section>
Expand Down
Binary file modified website/static/benchmarks/luna-android/javascript-control.mp4
Binary file not shown.
Binary file modified website/static/benchmarks/luna-android/javascript-stim.mp4
Binary file not shown.
Binary file modified website/static/benchmarks/luna-android/native-control.mp4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified website/static/benchmarks/opus-android/javascript-stim.mp4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified website/static/benchmarks/opus-android/native-stim.mp4
Binary file not shown.
Binary file modified website/static/benchmarks/sol-android/javascript-control.mp4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified website/static/benchmarks/sol-android/native-control.mp4
Binary file not shown.
Binary file modified website/static/benchmarks/sol-android/native-stim.mp4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified website/static/benchmarks/sol-launch-crash/launch-crash-stim.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Binary file not shown.
Binary file modified website/static/benchmarks/sonnet-android/javascript-stim.mp4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Loading