Skip to content

Batch fix for WPT layout - #44

Open
ldm0 wants to merge 1 commit into
mainfrom
layout-wpt-main
Open

Batch fix for WPT layout#44
ldm0 wants to merge 1 commit into
mainfrom
layout-wpt-main

Conversation

@ldm0

@ldm0 ldm0 commented Aug 12, 2026

Copy link
Copy Markdown
Member

No description provided.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

⚠️ Spider Bench infrastructure failed before a comparison could be produced.

Workflow: failure. Inspect the workflow run for the failing build, harness, or artifact step.

No benchmark result or performance conclusion is available for this run.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 30594c4fdea2 → HEAD 07c07c39e9ab; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 46.88 s 46.79 s -0.09 s (-0.19%)
Estimated CPU 37.33 s 36.76 s -0.57 s (-1.52%)
Peak PSS 480.26 MiB 445.61 MiB -34.66 MiB (-7.22%)
Peak RSS 478.43 MiB 447.65 MiB -30.78 MiB (-6.43%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.537, 2.539, 4.041, 5.042, 6.544, 7.545, 8.046, 9.047, 10.55, 12.051, 13.052, 14.553, 15.554, 17.055, 17.555, 18.557, 19.559, 21.063, 22.064, 23.565, 25.067, 26.067, 27.57, 28.571, 29.572, 30.072, 31.574, 32.574, 34.077, 35.58, 36.58, 38.081, 39.083, 40.585, 42.086, 43.087, 44.589, 45.59]
    y-axis "CPU percent" 0 --> 200
    line [61.9, 117.79, 149.95, 135.93, 149.79, 159.67, 135.83, 81.89, 139.84, 89.87, 65.98, 24.01, 7.98, 2, 0, 0, 0, 49.86, 55.91, 155.77, 101.91, 129.94, 109.96, 99.89, 119.85, 137.95, 99.86, 116.03, 89.82, 37.94, 94.01, 11.99, 13.99, 117.84, 13.97, 66.01, 143.78, 117.82]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.537, 2.539, 4.041, 5.042, 6.544, 7.545, 8.046, 9.047, 10.55, 12.051, 13.052, 14.553, 15.554, 17.055, 17.555, 18.557, 19.559, 21.063, 22.064, 23.565, 25.067, 26.067, 27.57, 28.571, 29.572, 30.072, 31.574, 32.574, 34.077, 35.58, 36.58, 38.081, 39.083, 40.585, 42.086, 43.087, 44.589, 45.59, 46.885]
    y-axis "Memory MiB" 0 --> 1000
    line [23.71, 137.12, 160.59, 202.22, 253.64, 222.65, 252.05, 252.63, 240.78, 241.48, 225.56, 211.12, 195.28, 194.21, 191.29, 191.2, 191.14, 191.14, 216.49, 229.63, 236.57, 273.35, 312.89, 324.2, 369.52, 478.43, 342.21, 211.37, 261.68, 245.5, 237.3, 205.92, 204.48, 212.1, 257.13, 235.24, 244.58, 217.82, 242.09, 0]
    line [21.95, 135.02, 158.55, 200.13, 254.73, 220.49, 249.89, 250.48, 238.62, 239.31, 223.4, 208.96, 193.12, 192.04, 189.13, 189.04, 188.98, 188.98, 214.33, 227.47, 234.41, 271.24, 310.53, 322.04, 367.47, 480.26, 334.54, 209.22, 259.52, 243.34, 235.16, 203.76, 202.32, 209.94, 254.97, 233.08, 242.42, 215.66, 239.93, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 1.536, 2.538, 4.04, 5.042, 6.542, 7.544, 9.046, 10.047, 11.551, 12.552, 14.055, 15.055, 16.555, 18.058, 19.059, 20.562, 21.563, 23.066, 24.067, 25.568, 26.57, 28.072, 28.572, 29.072, 30.574, 32.074, 33.077, 34.577, 35.577, 37.08, 38.082, 39.584, 40.584, 42.088, 43.089, 44.591, 45.592]
    y-axis "CPU percent" 0 --> 200
    line [29.96, 0, 9.98, 3.99, 53.92, 97.93, 141.94, 133.74, 111.83, 121.73, 83.83, 123.85, 62.02, 84.02, 107.79, 63.89, 107.91, 65.93, 123.79, 99.97, 131.89, 103.92, 99.84, 148.01, 114.05, 89.83, 141.93, 127.66, 14, 77.98, 5.98, 47.86, 39.95, 34.01, 57.91, 35.96, 7.99, 97.88]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.035, 1.536, 2.538, 4.04, 5.042, 6.542, 7.544, 9.046, 10.047, 11.551, 12.552, 14.055, 15.055, 16.555, 18.058, 19.059, 20.562, 21.563, 23.066, 24.067, 25.568, 26.57, 28.072, 28.572, 29.072, 30.574, 32.074, 33.077, 34.577, 35.577, 37.08, 38.082, 39.584, 40.584, 42.088, 43.089, 44.591, 45.592, 46.794]
    y-axis "Memory MiB" 0 --> 500
    line [23.73, 114.61, 114.61, 128.88, 122.93, 135.28, 189.28, 220.14, 248.61, 250.79, 243.72, 218.05, 243, 225.04, 224.63, 220.6, 212.95, 240.43, 212.16, 233.46, 315.38, 328.52, 330.73, 414.48, 447.65, 391.48, 239.2, 239.82, 249.21, 236.53, 241.53, 194.03, 207.57, 206.55, 208.05, 214.2, 205.35, 198.36, 228.78, 0]
    line [21.99, 112.55, 112.55, 126.82, 120.88, 132.85, 187.23, 218.09, 246.56, 250.23, 241.67, 216, 240.97, 222.98, 222.57, 218.54, 212.9, 238.37, 210.12, 231.51, 313.22, 326.48, 328.69, 412.42, 445.61, 388.29, 237.14, 237.76, 247.15, 234.47, 239.49, 191.97, 205.51, 204.5, 205.99, 212.14, 203.65, 196.31, 226.77, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.92 s +0.01 s (+0.04%)
Estimated CPU 0.45 s 0.42 s -0.03 s (-6.43%)
Peak PSS 86.75 MiB 87.75 MiB +1.01 MiB (+1.16%)
Peak RSS 88.77 MiB 89.80 MiB +1.03 MiB (+1.16%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 30594c4fdea2 → HEAD 41e7c61ab957; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2
Observed duration 37.63 s 52.43 s +14.80 s (+39.32%)
Estimated CPU 33.20 s 43.85 s +10.65 s (+32.09%)
Peak PSS 431.33 MiB 489.00 MiB +57.67 MiB (+13.37%)
Peak RSS 432.99 MiB 484.59 MiB +51.60 MiB (+11.92%)
Peak threads 26 27 +1 (+3.85%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.039, 4.039, 5.039, 5.539, 6.04, 6.541, 7.042, 7.543, 8.544, 9.545, 10.546, 11.548, 12.548, 13.55, 15.052, 16.053, 17.055, 18.055, 19.057, 20.058, 21.06, 22.061, 23.063, 24.566, 25.567, 26.568, 27.569, 28.57, 29.572, 30.574, 31.576, 32.576, 34.078, 35.079, 36.08, 37.08]
    y-axis "CPU percent" 0 --> 200
    line [55.93, 111.86, 95.95, 163.97, 142.03, 138.03, 93.84, 149.82, 121.76, 97.81, 97.95, 133.83, 49.93, 53.93, 100.04, 57.83, 127.65, 71.91, 131.82, 100.01, 115.69, 101.93, 137.82, 79.91, 133.82, 53.91, 13.98, 77.94, 5.99, 2, 101.68, 115.65, 127.7, 98.05, 9.99, 129.87, 79.91, 130.04]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.038, 3.039, 4.039, 5.039, 5.539, 6.04, 6.541, 7.042, 7.543, 8.544, 9.545, 10.546, 11.548, 12.548, 13.55, 15.052, 16.053, 17.055, 18.055, 19.057, 20.058, 21.06, 22.061, 23.063, 24.566, 25.567, 26.568, 27.569, 28.57, 29.572, 30.574, 31.576, 32.576, 34.078, 35.079, 36.08, 37.08, 37.633]
    y-axis "Memory MiB" 0 --> 500
    line [23.82, 120.91, 150.21, 181.79, 222.9, 246.14, 238.02, 226.33, 255.79, 249.05, 229.09, 240.86, 230.72, 209.43, 225.37, 184, 188.63, 230.46, 210.58, 224.59, 299.54, 294.27, 363.52, 432.99, 217.2, 242.24, 216.54, 210.18, 200.45, 197.59, 200.57, 260.88, 341.78, 247.59, 250.32, 226.76, 237.57, 224.33, 243.6, 0]
    line [22.36, 119.26, 148.56, 180.15, 223.6, 244.47, 236.39, 224.73, 254.15, 247.39, 227.38, 239.19, 229.04, 207.86, 223.68, 182.31, 186.94, 228.79, 208.9, 222.91, 297.95, 292.59, 361.88, 431.33, 215.51, 240.56, 214.85, 208.77, 198.76, 195.96, 198.88, 259.2, 340.09, 245.9, 248.63, 225.08, 235.88, 222.64, 241.79, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.535, 3.037, 4.539, 5.541, 6.042, 7.543, 9.044, 10.045, 11.547, 13.049, 14.552, 16.053, 17.554, 19.057, 20.558, 22.059, 23.56, 25.062, 25.563, 26.564, 27.565, 29.067, 30.567, 32.07, 33.571, 34.573, 35.073, 36.576, 38.078, 39.58, 41.081, 42.583, 44.086, 45.087, 46.59, 48.091, 49.592, 51.094]
    y-axis "CPU percent" 0 --> 500
    line [91.89, 87.79, 193.73, 201.54, 159.88, 71.93, 11.99, 13.99, 67.91, 5.99, 135.84, 71.92, 127.74, 75.85, 107.88, 69.98, 41.96, 47.98, 0, 63.99, 34, 125.81, 109.97, 123.89, 101.86, 137.74, 127.93, 103.85, 121.73, 17.98, 100.07, 17.96, 127.78, 101.86, 47.91, 11.99, 101.94, 105.75]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.535, 3.037, 4.539, 5.541, 6.042, 7.543, 9.044, 10.045, 11.547, 13.049, 14.552, 16.053, 17.554, 19.057, 20.558, 22.059, 23.56, 25.062, 25.563, 26.564, 27.565, 29.067, 30.567, 32.07, 33.571, 34.573, 35.073, 36.576, 38.078, 39.58, 41.081, 42.583, 44.086, 45.087, 46.59, 48.091, 49.592, 51.094, 52.43]
    y-axis "Memory MiB" 0 --> 1000
    line [23.99, 143.1, 179.97, 257, 328.1, 344.66, 343.54, 341.82, 343.38, 342.48, 342.32, 334.79, 320.45, 322.2, 284.72, 267.81, 273.53, 263.62, 176.5, 172.55, 186.68, 215.82, 228.92, 351.76, 324.55, 377.36, 484.59, 285.47, 225.08, 243.37, 215.43, 220.83, 222, 306.53, 346.87, 254.39, 218.83, 222.36, 226.32, 0]
    line [22.61, 141.48, 178.33, 255.51, 326.58, 343.01, 341.89, 340.19, 341.75, 340.8, 340.74, 333.13, 318.84, 319.45, 283.06, 266.15, 271.73, 261.98, 174.84, 170.89, 185.05, 200.01, 227.48, 347.04, 322.89, 375.72, 489, 283.82, 223.42, 241.71, 213.77, 219.18, 220.34, 305.09, 344.83, 252.73, 217.15, 220.7, 224.66, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.02 s 20.03 s +0.01 s (+0.05%)
Estimated CPU 0.47 s 0.47 s 0.00 s (0.00%)
Peak PSS 86.97 MiB 87.79 MiB +0.83 MiB (+0.95%)
Peak RSS 88.55 MiB 90.32 MiB +1.77 MiB (+2.00%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 41e7c61 to 356a922 Compare August 12, 2026 19:28
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 356a92297fb4; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.91 s 35.65 s -5.27 s (-12.87%)
Estimated CPU 34.52 s 31.31 s -3.21 s (-9.31%)
Peak PSS 503.98 MiB 513.71 MiB +9.73 MiB (+1.93%)
Peak RSS 505.55 MiB 518.39 MiB +12.84 MiB (+2.54%)
Peak threads 27 26 -1 (-3.70%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 2.537, 3.539, 4.039, 4.54, 5.541, 7.043, 8.044, 9.046, 10.546, 11.548, 12.548, 13.549, 15.052, 16.052, 17.053, 18.054, 19.556, 20.558, 21.56, 23.061, 23.562, 24.063, 25.063, 26.065, 27.567, 28.569, 29.57, 31.07, 32.072, 33.072, 34.074, 35.576, 36.578, 37.58, 38.581, 40.082]
    y-axis "CPU percent" 0 --> 200
    line [45.97, 105.93, 107.82, 91.96, 175.91, 127.86, 137.72, 125.81, 143.82, 133.83, 113.84, 37.95, 66.01, 121.64, 5.99, 19.99, 0, 81.92, 111.67, 99.83, 111.7, 97.84, 129.83, 127.78, 39.95, 125.86, 65.85, 15.99, 77.93, 10, 13.97, 107.81, 99.8, 45.94, 2, 63.84, 144.09, 109.84]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 2.537, 3.539, 4.039, 4.54, 5.541, 7.043, 8.044, 9.046, 10.546, 11.548, 12.548, 13.549, 15.052, 16.052, 17.053, 18.054, 19.556, 20.558, 21.56, 23.061, 23.562, 24.063, 25.063, 26.065, 27.567, 28.569, 29.57, 31.07, 32.072, 33.072, 34.074, 35.576, 36.578, 37.58, 38.581, 40.082, 40.913]
    y-axis "Memory MiB" 0 --> 1000
    line [23.22, 119.13, 146.56, 168.93, 183.58, 220.96, 244.75, 238.7, 251.93, 231.74, 239.37, 253.67, 218.96, 192.04, 200.61, 195.25, 194.72, 188.76, 225.41, 220.17, 290.92, 323.59, 406.48, 505.55, 227.89, 218.79, 235.96, 230.89, 219.63, 217.43, 211.66, 223.41, 284.56, 345.02, 248.18, 222.63, 212.16, 219.21, 240.59, 0]
    line [21.77, 117.49, 144.91, 167.28, 181.95, 219.32, 243.1, 237.06, 250.28, 230.1, 237.72, 252.03, 217.31, 189.12, 198.96, 193.6, 193.07, 187.11, 223.76, 218.63, 289.35, 321.94, 404.84, 503.98, 226.26, 216.92, 234.31, 229.25, 217.97, 215.78, 210.01, 221.76, 282.96, 343.37, 246.54, 220.97, 210.51, 217.56, 238.99, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.037, 3.539, 4.039, 4.54, 5.041, 6.043, 7.044, 8.046, 9.048, 10.049, 11.051, 12.052, 13.053, 14.055, 15.055, 16.056, 17.057, 18.058, 19.06, 20.062, 21.063, 22.065, 23.067, 24.067, 25.068, 26.07, 27.072, 28.074, 28.575, 29.075, 30.078, 31.079, 32.08, 33.082, 34.083, 35.083]
    y-axis "CPU percent" 0 --> 200
    line [49.93, 109.83, 95.94, 103.71, 171.78, 129.77, 147.75, 105.85, 129.74, 111.82, 79.82, 115.95, 33.96, 85.91, 37.93, 23.93, 87.94, 54.02, 101.86, 102, 107.71, 99.69, 123.8, 133.71, 139.79, 113.86, 19.97, 55.87, 95.86, 25.96, 2, 45.93, 89.76, 11.98, 31.99, 109.83, 61.92, 118.01]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.037, 3.539, 4.039, 4.54, 5.041, 6.043, 7.044, 8.046, 9.048, 10.049, 11.051, 12.052, 13.053, 14.055, 15.055, 16.056, 17.057, 18.058, 19.06, 20.062, 21.063, 22.065, 23.067, 24.067, 25.068, 26.07, 27.072, 28.074, 28.575, 29.075, 30.078, 31.079, 32.08, 33.082, 34.083, 35.083, 35.646]
    y-axis "Memory MiB" 0 --> 1000
    line [23.84, 124.33, 148.49, 180.09, 187.29, 199.21, 238.28, 239.83, 216.57, 242.86, 229.33, 212.68, 224.5, 220.37, 226.7, 188.8, 194.44, 228.51, 198.26, 217.45, 284.16, 328.59, 368.38, 518.39, 222.05, 231.17, 231.82, 217.38, 219.32, 214.89, 227.24, 218, 208.79, 209.45, 217.25, 217.1, 216.91, 217.58, 238.71, 0]
    line [22.38, 122.63, 146.79, 178.39, 191.33, 197.51, 236.44, 238.14, 214.98, 241.16, 227.64, 210.98, 222.79, 218.65, 224.99, 187.1, 192.72, 226.79, 196.54, 215.75, 282.47, 326.87, 366.67, 513.71, 220.34, 229.46, 230.11, 215.66, 217.6, 213.18, 225.52, 216.29, 207.08, 207.74, 215.53, 215.38, 215.19, 215.87, 237.03, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.15 s 19.98 s -0.17 s (-0.85%)
Estimated CPU 0.52 s 0.44 s -0.08 s (-15.13%)
Peak PSS 86.09 MiB 86.87 MiB +0.78 MiB (+0.91%)
Peak RSS 88.58 MiB 88.72 MiB +0.14 MiB (+0.15%)
Peak threads 20 18 -2 (-10.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD aeee44e9a143; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 38.09 s 37.82 s -0.27 s (-0.71%)
Estimated CPU 33.99 s 32.37 s -1.63 s (-4.78%)
Peak PSS 505.20 MiB 418.66 MiB -86.54 MiB (-17.13%)
Peak RSS 506.91 MiB 420.42 MiB -86.48 MiB (-17.06%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.039, 3.54, 4.541, 5.543, 6.544, 7.546, 9.048, 10.049, 11.05, 12.052, 13.053, 14.556, 15.557, 16.558, 17.56, 18.561, 20.064, 21.064, 21.565, 22.065, 23.066, 24.068, 25.569, 26.57, 27.57, 28.572, 29.574, 31.076, 32.078, 33.077, 34.078, 34.579, 35.08, 36.581, 37.582, 38.083]
    y-axis "CPU percent" 0 --> 200
    line [41.95, 107.82, 97.79, 121.69, 137.78, 129.76, 161.95, 109.82, 67.81, 99.89, 61.96, 73.83, 59.97, 55.94, 45.97, 45.97, 107.76, 97.89, 111.91, 99.92, 119.8, 129.84, 51.93, 107.85, 62.01, 21.99, 64, 7.99, 51.91, 123.82, 89.88, 47.96, 71.96, 0, 1.99, 69.91, 129.93, 69.82]
Loading
xychart-beta
    title "Base memory: RSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.038, 3.039, 3.54, 4.541, 5.543, 6.544, 7.546, 9.048, 10.049, 11.05, 12.052, 13.053, 14.556, 15.557, 16.558, 17.56, 18.561, 20.064, 21.064, 21.565, 22.065, 23.066, 24.068, 25.569, 26.57, 27.57, 28.572, 29.574, 31.076, 32.078, 33.077, 34.078, 34.579, 35.08, 36.581, 37.582, 38.083, 38.094]
    y-axis "Memory MiB" 0 --> 1000
    line [23.92, 123.43, 168.69, 183.34, 197.76, 235.2, 237.24, 264.84, 240.2, 207.27, 229.42, 214.31, 224.94, 187.2, 179.15, 220.93, 188.94, 207.87, 285.05, 343.33, 399.15, 506.91, 268.53, 216.13, 261.21, 218.04, 213.37, 203.59, 203.77, 205.05, 346.7, 264.55, 258.87, 270.64, 256.38, 249.54, 251.88, 267.48, 0, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.039, 3.041, 4.042, 5.044, 5.545, 6.046, 6.546, 7.547, 8.548, 9.55, 10.551, 11.552, 12.554, 13.555, 15.057, 16.059, 17.059, 18.06, 19.061, 20.062, 21.063, 22.065, 23.066, 24.568, 25.57, 26.572, 27.571, 28.573, 29.575, 30.577, 31.579, 32.58, 33.08, 34.08, 35.08, 36.081, 37.082]
    y-axis "CPU percent" 0 --> 200
    line [51.92, 105.82, 93.82, 173.8, 135.77, 135.79, 123.79, 118, 131.68, 121.97, 111.72, 110, 21.95, 69.86, 73.9, 43.94, 117.84, 95.85, 141.74, 101.94, 109.84, 101.84, 141.64, 59.95, 103.92, 73.84, 31.95, 74.02, 7.98, 39.92, 119.69, 61.86, 8, 2, 37.99, 158.01, 63.9, 125.97]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.037, 2.039, 3.041, 4.042, 5.044, 5.545, 6.046, 6.546, 7.547, 8.548, 9.55, 10.551, 11.552, 12.554, 13.555, 15.057, 16.059, 17.059, 18.06, 19.061, 20.062, 21.063, 22.065, 23.066, 24.568, 25.57, 26.572, 27.571, 28.573, 29.575, 30.577, 31.579, 32.58, 33.08, 34.08, 35.08, 36.081, 37.082, 37.822]
    y-axis "Memory MiB" 0 --> 500
    line [23.68, 123.81, 150.38, 183.75, 229.99, 259.14, 241.55, 224.5, 241.47, 242.98, 234.43, 207.8, 234.49, 220.88, 186.55, 190.08, 197.9, 233.16, 210.36, 238.08, 308.75, 328.09, 374.82, 420.42, 220.99, 251.36, 215.26, 211.94, 212.72, 212.51, 222.27, 303.02, 253.2, 215.95, 215.34, 228.84, 238.59, 225.35, 248.32, 0]
    line [22.21, 122.04, 148.62, 181.99, 228.22, 257.68, 239.79, 222.75, 241.47, 240.87, 233.56, 206.04, 232.63, 219.12, 184.79, 188.32, 196.14, 231.4, 208.61, 236.32, 307.08, 326.33, 373.06, 418.66, 219.22, 249.8, 213.49, 209.98, 210.95, 210.75, 220.51, 301.27, 251.44, 214.18, 213.57, 227.08, 236.83, 223.59, 246.77, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.96 s 19.99 s +0.03 s (+0.15%)
Estimated CPU 0.44 s 0.43 s -0.01 s (-2.26%)
Peak PSS 87.94 MiB 87.34 MiB -0.60 MiB (-0.69%)
Peak RSS 89.94 MiB 90.01 MiB +0.07 MiB (+0.08%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 308ef152c305; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 43.64 s 40.02 s -3.62 s (-8.30%)
Estimated CPU 37.19 s 35.22 s -1.97 s (-5.29%)
Peak PSS 484.16 MiB 445.28 MiB -38.88 MiB (-8.03%)
Peak RSS 485.85 MiB 446.81 MiB -39.04 MiB (-8.04%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 32 / 40 +5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.539, 3.54, 4.041, 4.541, 5.042, 6.043, 7.546, 8.547, 10.049, 11.05, 12.052, 13.554, 14.554, 16.056, 17.057, 18.559, 19.561, 21.062, 22.064, 23.066, 24.569, 25.57, 27.073, 28.074, 29.577, 30.579, 32.082, 33.082, 34.083, 35.585, 36.586, 38.087, 39.089, 40.09, 40.591, 41.592, 43.095]
    y-axis "CPU percent" 0 --> 200
    line [59.95, 107.81, 87.92, 163.88, 123.84, 153.9, 141.79, 159.7, 21.97, 63.87, 127.87, 15.97, 113.89, 82, 45.97, 97.88, 85.75, 101.81, 129.87, 127.64, 113.65, 133.76, 137.9, 145.79, 131.92, 77.86, 7.99, 71.83, 8, 27.95, 133.82, 133.95, 62.01, 3.99, 2, 47.92, 45.93, 125.76]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.539, 3.54, 4.041, 4.541, 5.042, 6.043, 7.546, 8.547, 10.049, 11.05, 12.052, 13.554, 14.554, 16.056, 17.057, 18.559, 19.561, 21.062, 22.064, 23.066, 24.569, 25.57, 27.073, 28.074, 29.577, 30.579, 32.082, 33.082, 34.083, 35.585, 36.586, 38.087, 39.089, 40.09, 40.591, 41.592, 43.095, 43.638]
    y-axis "Memory MiB" 0 --> 1000
    line [23.83, 121.66, 173.02, 184.39, 223.13, 243.97, 250.46, 231.58, 227.7, 210.21, 247.91, 269.55, 257.12, 207.09, 206.96, 195.51, 236.71, 206.55, 268.93, 318.89, 325.54, 332.83, 485.85, 219.97, 271.34, 250.18, 251.32, 231.45, 232.24, 230.45, 241.59, 349.56, 264.52, 223.69, 208.44, 217.09, 218.14, 208.82, 248.75, 0]
    line [22.35, 119.98, 171.35, 182.8, 221.45, 242.41, 248.78, 229.9, 225.37, 208.53, 246.19, 267.74, 255.46, 204.18, 205.53, 193.91, 235.02, 204.86, 267.34, 317.2, 323.9, 331.25, 484.16, 218.28, 269.64, 248.49, 249.63, 229.76, 230.55, 228.78, 239.9, 347.67, 262.29, 210.75, 206.75, 215.4, 215.87, 207.13, 247.07, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 3.039, 3.54, 4.041, 4.541, 5.543, 6.544, 8.045, 9.046, 10.048, 11.048, 12.05, 13.551, 14.552, 15.553, 16.554, 17.055, 18.056, 19.057, 20.058, 21.06, 22.062, 23.564, 24.565, 25.567, 26.568, 28.07, 29.072, 30.073, 31.074, 32.076, 33.578, 34.579, 35.581, 36.583, 38.085, 39.087]
    y-axis "CPU percent" 0 --> 200
    line [53.94, 105.8, 97.79, 121.64, 165.83, 131.81, 137.8, 109.87, 63.92, 103.85, 119.81, 100.04, 103.85, 67.95, 121.9, 99.88, 37.96, 2, 79.96, 55.96, 101.9, 99.82, 129.68, 113.77, 101.92, 115.81, 129.96, 119.83, 125.74, 19.98, 81.91, 33.96, 81.88, 105.88, 3.99, 2, 45.93, 109.87]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.035, 2.037, 3.039, 3.54, 4.041, 4.541, 5.543, 6.544, 8.045, 9.046, 10.048, 11.048, 12.05, 13.551, 14.552, 15.553, 16.554, 17.055, 18.056, 19.057, 20.058, 21.06, 22.062, 23.564, 24.565, 25.567, 26.568, 28.07, 29.072, 30.073, 31.074, 32.076, 33.578, 34.579, 35.581, 36.583, 38.085, 39.087, 40.017]
    y-axis "Memory MiB" 0 --> 500
    line [23.91, 127.29, 167.38, 179.8, 200.57, 224.66, 252.15, 229.02, 253.22, 232.22, 213.01, 240, 232.14, 223.04, 184.69, 187.42, 189.47, 177.17, 176.16, 217.86, 194, 215.8, 278.19, 309.23, 322.84, 364.05, 446.81, 219.82, 245.02, 241.35, 218.62, 220.83, 214.15, 255.84, 223.41, 210.24, 219.57, 210.02, 235, 0]
    line [22.44, 125.62, 165.7, 178.12, 198.92, 222.99, 250.48, 227.34, 251.43, 230.55, 211.35, 238.23, 230.46, 221.18, 183.04, 185.75, 187.8, 175.5, 174.49, 216.19, 192.32, 214.13, 276.62, 307.55, 321.16, 362.52, 445.28, 217.74, 243.34, 239.67, 216.94, 219.16, 212.47, 254.16, 221.74, 208.57, 217.9, 208.34, 233.32, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.08 s 19.99 s -0.08 s (-0.42%)
Estimated CPU 0.47 s 0.45 s -0.02 s (-4.23%)
Peak PSS 86.50 MiB 88.09 MiB +1.59 MiB (+1.84%)
Peak RSS 89.12 MiB 90.31 MiB +1.20 MiB (+1.34%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD bc891cb582cb; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 37.28 s 43.90 s +6.62 s (+17.76%)
Estimated CPU 33.97 s 36.25 s +2.27 s (+6.70%)
Peak PSS 500.68 MiB 499.04 MiB -1.64 MiB (-0.33%)
Peak RSS 502.30 MiB 497.72 MiB -4.58 MiB (-0.91%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.039, 4.04, 5.041, 6.043, 6.543, 7.545, 8.546, 9.548, 10.547, 11.549, 12.551, 13.551, 14.552, 15.553, 16.555, 17.555, 18.557, 19.058, 20.059, 21.06, 21.561, 22.061, 23.061, 24.063, 25.065, 26.065, 27.067, 28.068, 29.07, 30.072, 31.573, 32.574, 33.575, 34.575, 35.577, 36.579]
    y-axis "CPU percent" 0 --> 200
    line [55.94, 105.87, 89.79, 171.88, 139.81, 111.83, 95.97, 129.81, 131.83, 133.78, 90.02, 53.92, 99.83, 53.96, 41.99, 97.93, 47.92, 115.88, 99.84, 107.72, 105.92, 99.93, 127.75, 129.82, 90.03, 113.84, 95.85, 19.97, 81.87, 27.97, 23.96, 111.8, 125.8, 110.03, 2, 49.98, 15.97, 119.73]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.039, 4.04, 5.041, 6.043, 6.543, 7.545, 8.546, 9.548, 10.547, 11.549, 12.551, 13.551, 14.552, 15.553, 16.555, 17.555, 18.557, 19.058, 20.059, 21.06, 21.561, 22.061, 23.061, 24.063, 25.065, 26.065, 27.067, 28.068, 29.07, 30.072, 31.573, 32.574, 33.575, 34.575, 35.577, 36.579, 37.277]
    y-axis "Memory MiB" 0 --> 1000
    line [24.01, 123.85, 167.94, 183.34, 231.17, 249.12, 219.84, 247.63, 223.4, 237.67, 245.93, 237.41, 229.71, 236.15, 197.79, 198.96, 230.34, 198.88, 223.95, 300.56, 333.15, 342.06, 409.95, 502.3, 231.5, 223.13, 266.09, 232.51, 220.96, 221.85, 220.16, 230.78, 288.81, 286.01, 255.27, 236.54, 245.91, 234.11, 260.78, 0]
    line [22.53, 122.17, 166.28, 181.68, 229.49, 247.44, 218.45, 245.95, 221.71, 236.15, 244.48, 235.72, 228.01, 234.43, 196.1, 197.27, 228.65, 197.21, 222.5, 298.97, 331.46, 340.53, 408.25, 500.68, 229.79, 220.39, 264.47, 230.83, 219.27, 220.15, 218.47, 229.66, 287.16, 284.47, 253.58, 234.84, 244.22, 232.44, 259.08, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.537, 3.537, 4.039, 5.04, 6.04, 7.543, 8.543, 10.045, 11.047, 12.048, 13.548, 14.551, 16.053, 17.053, 18.555, 19.556, 21.058, 22.058, 23.059, 24.562, 25.063, 25.564, 27.066, 28.067, 29.57, 30.57, 32.072, 33.073, 34.075, 35.576, 36.579, 38.081, 38.581, 39.081, 40.583, 41.583, 43.085]
    y-axis "CPU percent" 0 --> 200
    line [39.88, 126.03, 93.92, 175.56, 141.8, 123.88, 123.83, 66, 129.89, 95.7, 73.9, 45.98, 7.98, 23.94, 81.94, 107.86, 115.84, 109.79, 115.95, 115.87, 101.83, 139.8, 125.87, 127.84, 119.8, 13.98, 73.99, 7.98, 8, 111.7, 133.81, 75.81, 2, 0, 0, 2, 132.02, 109.79]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.036, 2.537, 3.537, 4.039, 5.04, 6.04, 7.543, 8.543, 10.045, 11.047, 12.048, 13.548, 14.551, 16.053, 17.053, 18.555, 19.556, 21.058, 22.058, 23.059, 24.562, 25.063, 25.564, 27.066, 28.067, 29.57, 30.57, 32.072, 33.073, 34.075, 35.576, 36.579, 38.081, 38.581, 39.081, 40.583, 41.583, 43.085, 43.899]
    y-axis "Memory MiB" 0 --> 1000
    line [23.96, 121.33, 169.79, 190.92, 229.23, 256.89, 222.37, 245.57, 233.81, 231.21, 227.52, 219.05, 193.09, 188.95, 186.09, 221.65, 210.71, 226.9, 338.18, 338.59, 333.51, 400.65, 497.72, 280.17, 230.91, 225.75, 213.97, 221.3, 212.17, 219.51, 280.68, 283.54, 247.15, 208.78, 206.78, 206.78, 219.34, 218.98, 236.09, 0]
    line [22.49, 119.73, 168.1, 189.13, 227.54, 255.32, 220.68, 243.9, 232.14, 229.89, 225.81, 217.38, 191.38, 187.24, 184.39, 219.95, 209, 225.2, 336.48, 336.89, 331.81, 398.95, 499.04, 278.47, 229.22, 224.05, 212.27, 219.6, 210.47, 218.09, 278.99, 281.83, 245.45, 207.08, 205.08, 205.08, 217.64, 217.28, 234.46, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.99 s 20.06 s +0.07 s (+0.33%)
Estimated CPU 0.48 s 0.45 s -0.03 s (-6.03%)
Peak PSS 87.68 MiB 88.20 MiB +0.53 MiB (+0.60%)
Peak RSS 89.77 MiB 90.71 MiB +0.94 MiB (+1.05%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 826f17e601f9; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 45.86 s 37.27 s -8.58 s (-18.72%)
Estimated CPU 34.68 s 32.48 s -2.20 s (-6.35%)
Peak PSS 458.62 MiB 463.67 MiB +5.06 MiB (+1.10%)
Peak RSS 460.30 MiB 465.37 MiB +5.07 MiB (+1.10%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.034, 1.534, 2.536, 4.039, 5.04, 6.54, 7.541, 8.042, 9.044, 10.046, 11.547, 13.049, 14.05, 15.553, 16.554, 18.057, 19.057, 20.558, 21.559, 23.062, 24.562, 25.564, 26.565, 27.066, 28.066, 29.567, 30.568, 32.071, 33.072, 34.573, 36.075, 37.077, 38.578, 39.579, 41.08, 42.08, 43.582, 44.584]
    y-axis "CPU percent" 0 --> 200
    line [27.98, 0, 123.81, 87.94, 155.89, 143.8, 113.91, 163.66, 59.89, 89.87, 81.88, 13.99, 2, 121.78, 111.92, 35.94, 2, 116.01, 75.85, 109.91, 110.09, 103.78, 137.84, 123.93, 46.02, 139.72, 103.96, 33.92, 93.84, 17.99, 115.78, 103.83, 85.91, 5.99, 29.96, 0, 141.91, 101.9]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 1.534, 2.536, 4.039, 5.04, 6.54, 7.541, 8.042, 9.044, 10.046, 11.547, 13.049, 14.05, 15.553, 16.554, 18.057, 19.057, 20.558, 21.559, 23.062, 24.562, 25.564, 26.565, 27.066, 28.066, 29.567, 30.568, 32.071, 33.072, 34.573, 36.075, 37.077, 38.578, 39.579, 41.08, 42.08, 43.582, 44.584, 45.857]
    y-axis "Memory MiB" 0 --> 500
    line [24.18, 120.6, 118.14, 155.13, 178.12, 241.36, 247.65, 258.7, 240.61, 232.83, 242.17, 246.18, 184.77, 181.92, 200.04, 195.2, 190.04, 183.07, 237.21, 211.45, 256.44, 329.37, 361.41, 460.3, 236.54, 227.05, 262.87, 224.45, 211.09, 206.8, 211.53, 310.38, 353.73, 246.69, 208.9, 213.64, 208.06, 198.37, 215.98, 0]
    line [22.69, 118.91, 116.46, 153.44, 176.27, 239.67, 245.95, 257, 238.91, 231.28, 240.47, 244.48, 183.07, 180.22, 198.34, 193.49, 188.34, 181.37, 235.51, 209.67, 254.79, 327.67, 359.74, 458.62, 234.84, 225.36, 261.17, 222.74, 209.38, 205.1, 209.83, 309.8, 353.08, 244.99, 207.2, 212.11, 206.36, 196.67, 214.32, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.038, 4.04, 5.042, 6.543, 7.044, 7.545, 8.545, 9.545, 10.546, 11.546, 12.547, 13.548, 14.55, 15.552, 16.552, 17.553, 19.054, 20.054, 21.055, 22.056, 22.556, 23.057, 24.059, 25.061, 26.063, 27.065, 28.066, 29.067, 30.068, 31.57, 32.571, 33.573, 34.074, 34.575, 35.577, 36.577]
    y-axis "CPU percent" 0 --> 200
    line [49.95, 99.9, 99.81, 139.93, 155.65, 131.87, 155.76, 127.81, 129.95, 137.9, 74.03, 44.02, 99.85, 61.96, 39.99, 55.86, 40.03, 133.85, 100.03, 113.92, 99.92, 104.03, 131.78, 143.77, 123.7, 105.84, 71.85, 17.96, 78.05, 21.97, 30.02, 95.83, 61.97, 65.84, 0, 63.88, 43.94, 119.95]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.038, 4.04, 5.042, 6.543, 7.044, 7.545, 8.545, 9.545, 10.546, 11.546, 12.547, 13.548, 14.55, 15.552, 16.552, 17.553, 19.054, 20.054, 21.055, 22.056, 22.556, 23.057, 24.059, 25.061, 26.063, 27.065, 28.066, 29.067, 30.068, 31.57, 32.571, 33.573, 34.074, 34.575, 35.577, 36.577, 37.272]
    y-axis "Memory MiB" 0 --> 500
    line [23.85, 124.07, 146.14, 174.37, 203.65, 239.38, 247, 249.38, 239.87, 241.26, 244.67, 228.82, 223.96, 219.42, 199.77, 197.4, 208.13, 194.63, 220.81, 287.39, 391.99, 365.81, 449.07, 465.37, 230.58, 234.49, 264.97, 225.96, 215.7, 216.8, 218.44, 228.39, 260.12, 253.23, 263.78, 263.81, 251.3, 240.79, 260.2, 0]
    line [22.38, 122.4, 144.46, 172.7, 201.98, 237.57, 244.88, 247.71, 238.2, 239.59, 243, 227.13, 222.29, 217.75, 198.16, 195.73, 206.46, 192.96, 219.1, 285.73, 390.32, 364.28, 447.58, 463.67, 228.91, 233.56, 263.3, 224.29, 214.2, 215.12, 216.77, 226.72, 258.45, 251.56, 262.1, 262.14, 249.52, 238.96, 258.53, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.99 s 19.91 s -0.08 s (-0.42%)
Estimated CPU 0.47 s 0.45 s -0.02 s (-4.03%)
Peak PSS 87.59 MiB 87.96 MiB +0.37 MiB (+0.42%)
Peak RSS 90.08 MiB 89.94 MiB -0.14 MiB (-0.15%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 300a2b6314b7; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.00 s 41.94 s +1.93 s (+4.84%)
Estimated CPU 33.94 s 36.73 s +2.79 s (+8.23%)
Peak PSS 467.01 MiB 438.46 MiB -28.56 MiB (-6.12%)
Peak RSS 468.81 MiB 440.20 MiB -28.62 MiB (-6.10%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 3.039, 3.541, 4.041, 4.542, 5.043, 5.543, 6.544, 8.044, 9.045, 10.046, 11.048, 12.048, 13.55, 14.552, 15.554, 16.554, 18.054, 19.056, 20.057, 21.057, 22.058, 23.559, 24.56, 25.561, 26.563, 28.064, 29.065, 30.066, 31.067, 32.07, 33.57, 34.571, 35.572, 36.573, 38.074, 39.075]
    y-axis "CPU percent" 0 --> 200
    line [49.88, 107.79, 109.91, 119.67, 145.91, 125.86, 165.58, 135.94, 89.88, 45.94, 48.03, 135.93, 43.88, 42, 123.76, 85.85, 61.88, 98.06, 95.93, 97.88, 111.85, 100.01, 115.86, 47.94, 109.82, 123.98, 23.97, 97.95, 9.99, 41.95, 127.94, 99.8, 82, 2, 2, 0, 39.96, 113.88]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.035, 2.037, 3.039, 3.541, 4.041, 4.542, 5.043, 5.543, 6.544, 8.044, 9.045, 10.046, 11.048, 12.048, 13.55, 14.552, 15.554, 16.554, 18.054, 19.056, 20.057, 21.057, 22.058, 23.559, 24.56, 25.561, 26.563, 28.064, 29.065, 30.066, 31.067, 32.07, 33.57, 34.571, 35.572, 36.573, 38.074, 39.075, 40.002]
    y-axis "Memory MiB" 0 --> 500
    line [23.91, 120.91, 144.99, 175.14, 197.52, 219.4, 238.77, 228.39, 227.17, 246.87, 229.19, 243.57, 240.62, 217.88, 221.05, 187.84, 187.28, 180.43, 229.77, 211.04, 270.79, 384.67, 345.79, 468.81, 217.2, 233.78, 234.91, 210.26, 212.24, 214.11, 218.84, 286.47, 353.98, 252.46, 213.01, 211.36, 217.91, 209.86, 233.8, 0]
    line [22.49, 119.24, 143.32, 173.79, 195.88, 217.73, 237.04, 226.69, 223.92, 245.29, 227.48, 241.87, 240.29, 216.17, 219.35, 186.13, 185.58, 178.76, 228.07, 209.33, 269.09, 382.96, 344.21, 467.01, 215.78, 232.08, 232.65, 208.63, 210.54, 212.41, 217.14, 284.83, 352.27, 250.66, 211.31, 209.66, 216.21, 208.16, 232.16, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 2.538, 3.538, 4.039, 4.54, 6.042, 7.043, 8.044, 9.547, 10.549, 11.55, 13.052, 14.054, 15.055, 16.557, 17.558, 18.559, 20.06, 21.061, 22.063, 23.563, 24.063, 24.564, 25.565, 27.066, 28.068, 29.07, 30.572, 31.574, 32.575, 34.076, 35.079, 36.08, 37.583, 38.585, 39.586, 41.088]
    y-axis "CPU percent" 0 --> 200
    line [41.96, 105.92, 125.85, 99.9, 169.7, 131.86, 117.89, 123.8, 87.86, 95.75, 81.77, 0, 99.89, 53.96, 27.98, 107.86, 121.94, 137.8, 111.92, 127.94, 103.75, 104, 143.9, 149.9, 111.87, 119.97, 35.93, 21.96, 81.88, 15.98, 37.93, 119.9, 133.69, 83.83, 7.99, 51.95, 127.77, 107.86]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.037, 2.538, 3.538, 4.039, 4.54, 6.042, 7.043, 8.044, 9.547, 10.549, 11.55, 13.052, 14.054, 15.055, 16.557, 17.558, 18.559, 20.06, 21.061, 22.063, 23.563, 24.063, 24.564, 25.565, 27.066, 28.068, 29.07, 30.572, 31.574, 32.575, 34.076, 35.079, 36.08, 37.583, 38.585, 39.586, 41.088, 41.937]
    y-axis "Memory MiB" 0 --> 500
    line [23.69, 123.22, 148.46, 176.88, 200.86, 227.88, 241.78, 212.57, 244.79, 236.55, 230.42, 212.92, 200.8, 200.43, 190.14, 191.01, 234.49, 206.93, 232.89, 417.99, 328.21, 344.57, 429.48, 440.2, 224.09, 217.17, 249.06, 237.53, 234.87, 230.8, 236.37, 230.63, 361.18, 266.35, 244.25, 206.15, 205.69, 195.6, 227.19, 0]
    line [22.23, 121.53, 146.78, 175.19, 199.17, 226.19, 240.45, 210.83, 243.05, 234.81, 228.68, 211.18, 199.06, 198.69, 188.41, 189.27, 232.75, 205.19, 231.27, 401.03, 326.48, 342.91, 427.74, 438.46, 222.35, 215.43, 247.32, 235.79, 233.13, 229.06, 234.63, 228.89, 359.44, 264.61, 242.51, 204.41, 203.95, 193.86, 225.55, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.06 s 19.99 s -0.07 s (-0.34%)
Estimated CPU 0.48 s 0.50 s +0.02 s (+3.94%)
Peak PSS 85.80 MiB 87.45 MiB +1.65 MiB (+1.92%)
Peak RSS 88.26 MiB 89.50 MiB +1.24 MiB (+1.41%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD ca45cfb115c0; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 177 / 240 179 / 240 +2 (+1.13%)
Contract fill 73.75% 74.58% +0.83 pp (+1.13%)
Sites with rows 36 / 48 37 / 48 +1 (+2.78%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 12 11 -1 (-8.33%)
Partial-row sites 1 2 +1 (+100.00%)
Site outcomes extracted: 35; HTTP error + rows: 1; empty: 7; HTTP error + empty: 2; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 38.00 s 41.62 s +3.62 s (+9.53%)
Estimated CPU 31.01 s 34.19 s +3.18 s (+10.25%)
Peak PSS 458.91 MiB 442.03 MiB -16.88 MiB (-3.68%)
Peak RSS 460.72 MiB 443.73 MiB -16.99 MiB (-3.69%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 35 / 40 37 / 40 +2
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.041, 2.043, 3.044, 4.045, 5.047, 5.548, 6.549, 7.049, 7.549, 8.552, 9.553, 10.555, 11.557, 12.558, 13.56, 15.062, 16.062, 17.063, 18.064, 19.065, 20.067, 21.068, 22.069, 23.07, 23.57, 24.571, 25.572, 26.574, 27.575, 28.577, 29.578, 30.579, 31.58, 32.581, 34.083, 35.085, 36.086, 37.087]
    y-axis "CPU percent" 0 --> 200
    line [23.98, 111.81, 105.93, 157.82, 133.76, 131.75, 114.02, 171.95, 133.93, 131.67, 127.87, 111.72, 59.89, 0, 0, 125.93, 71.98, 35.99, 77.94, 93.87, 105.8, 113.92, 103.9, 107.79, 129.93, 41.92, 127.82, 109.78, 12, 77.86, 49.94, 21.97, 59.93, 50.01, 2, 63.92, 25.97, 119.85]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.04, 1.041, 2.043, 3.044, 4.045, 5.047, 5.548, 6.549, 7.049, 7.549, 8.552, 9.553, 10.555, 11.557, 12.558, 13.56, 15.062, 16.062, 17.063, 18.064, 19.065, 20.067, 21.068, 22.069, 23.07, 23.57, 24.571, 25.572, 26.574, 27.575, 28.577, 29.578, 30.579, 31.58, 32.581, 34.083, 35.085, 36.086, 37.087, 37.997]
    y-axis "Memory MiB" 0 --> 500
    line [23.78, 117.2, 170.63, 195.34, 220.45, 247.91, 243.24, 251.84, 250.78, 238.72, 242.69, 249.4, 232.8, 226.34, 221.97, 171.98, 189.29, 190.46, 192.71, 228.5, 211.59, 264.48, 375.58, 356.09, 434.38, 460.72, 218.9, 236.25, 222.52, 207.49, 212.11, 204.68, 215.16, 205.07, 219.04, 213.83, 219.71, 206.95, 240.5, 0]
    line [22.28, 115.51, 168.85, 193.65, 218.77, 246.19, 241.57, 250.13, 249.09, 235.28, 240.86, 247.69, 231.09, 224.69, 220.25, 170.26, 187.57, 188.73, 190.98, 224.32, 210.03, 262.84, 373.84, 354.5, 432.71, 458.91, 217.16, 238.14, 220.67, 205.75, 210.38, 202.95, 213.43, 203.33, 217.3, 212.09, 217.97, 205.21, 238.76, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 2.539, 3.039, 3.54, 4.541, 6.043, 7.045, 8.047, 9.55, 10.553, 11.553, 13.055, 14.057, 15.057, 16.559, 17.561, 18.562, 20.063, 21.065, 22.067, 23.568, 24.567, 25.569, 27.07, 28.072, 29.074, 30.575, 31.577, 32.579, 34.081, 35.081, 36.083, 37.585, 38.086, 38.586, 39.587, 41.088]
    y-axis "CPU percent" 0 --> 200
    line [55.93, 113.8, 129.8, 101.91, 91.87, 169.77, 135.79, 119.79, 117.76, 113.76, 131.57, 91.99, 95.88, 27.93, 4, 27.96, 113.8, 79.91, 99.81, 113.95, 103.72, 136.06, 82.03, 141.78, 49.92, 23.96, 73.89, 9.98, 5.99, 101.85, 103.94, 40, 87.82, 63.91, 0, 43.94, 46.02, 119.8]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.038, 2.539, 3.039, 3.54, 4.541, 6.043, 7.045, 8.047, 9.55, 10.553, 11.553, 13.055, 14.057, 15.057, 16.559, 17.561, 18.562, 20.063, 21.065, 22.067, 23.568, 24.567, 25.569, 27.07, 28.072, 29.074, 30.575, 31.577, 32.579, 34.081, 35.081, 36.083, 37.585, 38.086, 38.586, 39.587, 41.088, 41.619]
    y-axis "Memory MiB" 0 --> 500
    line [24.12, 124.13, 148.34, 175.44, 195.19, 186.2, 226.34, 236.97, 252.08, 243.74, 244.41, 251.26, 236, 202.71, 192.64, 188.86, 190.48, 230.06, 206.42, 271.73, 381.05, 339.48, 443.73, 207.59, 225.63, 224.76, 220.57, 219.25, 222.04, 219.21, 280.03, 351.97, 231.07, 230.21, 230.43, 214.04, 217.1, 210.07, 245.26, 0]
    line [22.61, 122.41, 146.63, 173.81, 193.47, 184.49, 224.74, 235.26, 250.64, 242.04, 242.69, 249.56, 234.3, 200.98, 190.92, 187.13, 188.75, 228.33, 204.64, 270.09, 379.32, 337.92, 442.03, 205.86, 224.47, 223.01, 219.01, 217.79, 220.3, 217.46, 278.29, 350.71, 229.32, 228.46, 228.68, 212.29, 216.96, 208.32, 243.51, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.99 s +0.07 s (+0.37%)
Estimated CPU 0.44 s 0.42 s -0.02 s (-4.30%)
Peak PSS 88.56 MiB 88.16 MiB -0.40 MiB (-0.45%)
Peak RSS 90.24 MiB 90.78 MiB +0.54 MiB (+0.59%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD f68c37dc3d79; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 8; HTTP error + empty: 1; snapshot error + empty: 2 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 44.46 s 39.34 s -5.12 s (-11.51%)
Estimated CPU 36.52 s 34.74 s -1.78 s (-4.88%)
Peak PSS 453.59 MiB 463.75 MiB +10.16 MiB (+2.24%)
Peak RSS 465.36 MiB 465.45 MiB +0.09 MiB (+0.02%)
Peak threads 27 26 -1 (-3.70%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.034, 2.536, 3.537, 4.038, 5.04, 6.041, 7.543, 8.544, 10.047, 11.049, 12.551, 13.554, 14.054, 15.054, 16.056, 17.558, 18.56, 20.062, 21.063, 22.563, 23.565, 24.567, 26.068, 26.569, 27.07, 28.573, 29.574, 31.078, 32.079, 33.579, 34.581, 36.082, 37.082, 38.584, 39.586, 41.086, 42.087, 43.587]
    y-axis "CPU percent" 0 --> 200
    line [53.97, 103.85, 81.95, 163.59, 141.81, 101.88, 159.71, 85.95, 79.87, 127.77, 15.97, 5.99, 0, 79.94, 43.96, 19.98, 67.94, 79.94, 131.83, 113.92, 131.89, 101.94, 99.85, 139.82, 131.89, 121.65, 29.95, 39.92, 17.97, 89.95, 7.99, 90.04, 127.97, 55.87, 13.99, 0, 127.8, 120.01]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 2.536, 3.537, 4.038, 5.04, 6.041, 7.543, 8.544, 10.047, 11.049, 12.551, 13.554, 14.054, 15.054, 16.056, 17.558, 18.56, 20.062, 21.063, 22.563, 23.565, 24.567, 26.068, 26.569, 27.07, 28.573, 29.574, 31.078, 32.079, 33.579, 34.581, 36.082, 37.082, 38.584, 39.586, 41.086, 42.087, 43.587, 44.457]
    y-axis "Memory MiB" 0 --> 500
    line [23.77, 118.25, 169.4, 184.02, 225.4, 252.17, 228.95, 261.23, 231.12, 207.37, 231.03, 171.44, 171.95, 170.96, 196.6, 191.26, 191.23, 207.71, 210.07, 225.5, 373.82, 331.59, 344.61, 413.62, 465.36, 232.4, 241.41, 267.18, 229.16, 219.77, 229.94, 223.04, 276.76, 359.29, 277.35, 242.63, 259.81, 246.62, 261.68, 0]
    line [22.28, 116.57, 168.02, 182.34, 223.21, 250.48, 227.27, 259.54, 229.43, 205.68, 229.34, 169.75, 170.27, 169.28, 194.91, 189.57, 189.48, 206.03, 208.47, 223.82, 372.87, 329.9, 348.43, 411.97, 453.59, 230.71, 239.73, 265.87, 227.48, 218.08, 228.29, 221.38, 276.15, 357.61, 275.68, 240.95, 258.13, 244, 260.05, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.037, 3.537, 4.038, 4.539, 5.04, 5.54, 6.541, 7.543, 9.043, 10.045, 11.046, 12.048, 13.049, 14.551, 15.552, 16.553, 17.554, 18.555, 20.057, 21.059, 22.06, 23.061, 24.063, 25.065, 26.566, 27.568, 28.569, 29.57, 30.571, 32.073, 33.074, 34.076, 35.077, 36.078, 37.58, 38.581]
    y-axis "CPU percent" 0 --> 200
    line [55.94, 109.84, 97.97, 121.95, 147.59, 127.84, 137.85, 133.85, 159.8, 75.89, 131.95, 103.81, 113.87, 43.94, 41.97, 115.93, 73.8, 45.95, 98.04, 121.87, 101.82, 107.9, 99.77, 135.82, 147.81, 129.82, 81.87, 19.97, 73.95, 7.99, 9.99, 129.86, 133.95, 107.99, 6, 0, 17.98, 119.75]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.037, 3.537, 4.038, 4.539, 5.04, 5.54, 6.541, 7.543, 9.043, 10.045, 11.046, 12.048, 13.049, 14.551, 15.552, 16.553, 17.554, 18.555, 20.057, 21.059, 22.06, 23.061, 24.063, 25.065, 26.566, 27.568, 28.569, 29.57, 30.571, 32.073, 33.074, 34.076, 35.077, 36.078, 37.58, 38.581, 39.341]
    y-axis "Memory MiB" 0 --> 500
    line [23.98, 123.26, 147.45, 182.77, 210.39, 213.73, 242.42, 227.78, 231.04, 253.59, 227.98, 233.97, 227.88, 213.65, 208.18, 190.79, 189.79, 191.64, 191.79, 233.1, 209.39, 286.64, 329.15, 355.3, 465.45, 225.1, 216.55, 211.16, 201.91, 201.53, 205.05, 208.14, 354.39, 287.17, 237.85, 203.95, 214.43, 203.19, 234.77, 0]
    line [22.48, 121.59, 145.77, 181.08, 208.72, 212.11, 241.15, 226.11, 227.77, 251.91, 226.31, 232.33, 226.18, 211.96, 206.48, 189.1, 188.09, 189.94, 190.09, 231.41, 207.69, 285.08, 327.45, 353.65, 463.75, 223.41, 214.68, 209.46, 200.21, 199.84, 203.36, 207.49, 352.7, 284.73, 236.15, 202.26, 212.73, 201.49, 233.07, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.04 s 19.95 s -0.09 s (-0.47%)
Estimated CPU 0.46 s 0.41 s -0.05 s (-10.82%)
Peak PSS 85.66 MiB 88.98 MiB +3.32 MiB (+3.88%)
Peak RSS 88.35 MiB 91.08 MiB +2.73 MiB (+3.10%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 02ac282b1efe; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 37.03 s 41.73 s +4.70 s (+12.68%)
Estimated CPU 32.01 s 33.05 s +1.03 s (+3.23%)
Peak PSS 434.67 MiB 461.47 MiB +26.80 MiB (+6.17%)
Peak RSS 436.41 MiB 463.21 MiB +26.80 MiB (+6.14%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.038, 4.039, 4.539, 5.04, 5.541, 6.041, 6.542, 7.043, 8.044, 9.546, 10.548, 11.548, 12.55, 13.551, 14.552, 15.553, 16.555, 17.556, 18.557, 19.559, 20.561, 21.562, 22.563, 23.564, 24.564, 25.566, 26.568, 28.07, 29.071, 30.071, 31.073, 32.073, 33.074, 34.076, 35.077, 36.078]
    y-axis "CPU percent" 0 --> 200
    line [49.94, 101.84, 99.94, 151.88, 125.83, 155.81, 135.81, 107.88, 163.8, 109.78, 77.91, 137.75, 105.85, 0, 73.84, 123.86, 49.95, 31.98, 101.93, 67.93, 135.63, 99.81, 109.92, 101.92, 137.78, 65.99, 136.1, 105.78, 23.98, 79.96, 21.98, 103.93, 73.92, 85.89, 9.99, 0, 87.93, 113.89]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.036, 2.038, 3.038, 4.039, 4.539, 5.04, 5.541, 6.041, 6.542, 7.043, 8.044, 9.546, 10.548, 11.548, 12.55, 13.551, 14.552, 15.553, 16.555, 17.556, 18.557, 19.559, 20.561, 21.562, 22.563, 23.564, 24.564, 25.566, 26.568, 28.07, 29.071, 30.071, 31.073, 32.073, 33.074, 34.076, 35.077, 36.078, 37.034]
    y-axis "Memory MiB" 0 --> 500
    line [23.95, 124.62, 150.26, 178.21, 204.65, 225.06, 229.55, 226.54, 224.62, 246.95, 241.84, 228.05, 243.93, 224.34, 214.31, 184.46, 198.45, 196.03, 191.71, 227.8, 207.2, 223.01, 302.25, 302.59, 369.81, 436.41, 223.09, 236.79, 216.2, 203.95, 204.83, 214.4, 266.34, 238.7, 234.36, 221.77, 233.73, 212.99, 240.24, 0]
    line [22.41, 122.9, 148.54, 176.25, 202.92, 223.31, 227.8, 224.79, 223.29, 245.23, 240.08, 226.3, 242.18, 222.85, 212.56, 182.72, 196.69, 194.28, 190.04, 226.05, 205.46, 221.27, 300.57, 302.83, 368.21, 434.67, 221.33, 235.03, 214.6, 202.19, 203.08, 212.65, 264.5, 236.95, 232.6, 220.02, 231.98, 211.24, 238.5, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.034, 2.534, 3.535, 4.536, 6.038, 6.539, 7.04, 8.042, 9.545, 10.546, 11.045, 11.546, 13.048, 14.049, 15.05, 16.551, 17.552, 18.554, 20.056, 21.057, 22.058, 23.558, 24.559, 25.56, 26.06, 27.062, 28.063, 29.065, 30.567, 31.568, 32.569, 34.071, 35.073, 36.074, 37.577, 38.577, 39.578, 41.079]
    y-axis "CPU percent" 0 --> 200
    line [23.97, 122.03, 141.95, 135.84, 16, 0, 11.97, 9.98, 89.76, 125.94, 162.1, 129.82, 93.84, 133.9, 69.93, 101.91, 73.95, 43.96, 97.92, 85.95, 131.87, 110, 103.97, 99.89, 129.91, 105.84, 131.87, 115.76, 17.98, 67.81, 35.96, 49.93, 105.82, 85.88, 61.92, 52.08, 45.94, 127.79]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 2.534, 3.535, 4.536, 6.038, 6.539, 7.04, 8.042, 9.545, 10.546, 11.045, 11.546, 13.048, 14.049, 15.05, 16.551, 17.552, 18.554, 20.056, 21.057, 22.058, 23.558, 24.559, 25.56, 26.06, 27.062, 28.063, 29.065, 30.567, 31.568, 32.569, 34.071, 35.073, 36.074, 37.577, 38.577, 39.578, 41.079, 41.731]
    y-axis "Memory MiB" 0 --> 500
    line [23.79, 111.03, 177.54, 207.34, 256.25, 221.15, 220.95, 218.97, 218.73, 237.75, 249.73, 246.39, 235.99, 233.72, 239.22, 221.05, 232.52, 232.84, 217.13, 246.79, 210.29, 224.33, 375.7, 350.84, 409.54, 463.21, 221.93, 228.02, 231.75, 213.88, 214.41, 215.82, 224.27, 227.79, 227.06, 231.18, 210.7, 203.75, 245.61, 0]
    line [22.29, 109.31, 175.76, 205.56, 254.49, 219.37, 219.17, 217.19, 216.95, 235.97, 247.95, 244.24, 234.22, 231.95, 235.67, 219.27, 230.74, 231.05, 215.34, 245.01, 208.54, 222.54, 374, 349.3, 407.75, 461.47, 220.15, 226.41, 229.97, 212.09, 212.63, 214.03, 222.48, 226.01, 225.28, 229.39, 209.07, 201.97, 243.84, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.98 s 20.02 s +0.04 s (+0.19%)
Estimated CPU 0.44 s 0.47 s +0.03 s (+6.55%)
Peak PSS 86.99 MiB 86.66 MiB -0.33 MiB (-0.38%)
Peak RSS 89.36 MiB 89.26 MiB -0.11 MiB (-0.12%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD c6d6ac392a1e; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.94 s 39.22 s -1.72 s (-4.21%)
Estimated CPU 35.95 s 33.33 s -2.62 s (-7.29%)
Peak PSS 491.14 MiB 429.94 MiB -61.21 MiB (-12.46%)
Peak RSS 493.32 MiB 431.99 MiB -61.32 MiB (-12.43%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.536, 3.036, 3.536, 4.537, 5.54, 7.04, 7.54, 8.041, 9.043, 10.545, 11.546, 12.546, 13.547, 15.049, 16.051, 17.052, 18.053, 19.554, 20.555, 21.555, 23.058, 24.059, 25.059, 26.06, 27.561, 28.562, 29.563, 31.065, 32.066, 33.068, 34.069, 35.57, 36.573, 37.575, 38.575, 40.078]
    y-axis "CPU percent" 0 --> 200
    line [0, 77.91, 106.01, 87.99, 121.98, 131.62, 143.71, 118.05, 167.75, 123.81, 123.89, 139.87, 83.92, 48.03, 111.88, 9.99, 55.98, 31.96, 99.92, 100, 129.87, 121.9, 99.85, 121.78, 147.88, 109.92, 109.83, 14.01, 75.9, 6, 45.93, 119.84, 103.77, 37.97, 45.9, 1.99, 125.88, 109.85]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.036, 2.536, 3.036, 3.536, 4.537, 5.54, 7.04, 7.54, 8.041, 9.043, 10.545, 11.546, 12.546, 13.547, 15.049, 16.051, 17.052, 18.053, 19.554, 20.555, 21.555, 23.058, 24.059, 25.059, 26.06, 27.561, 28.562, 29.563, 31.065, 32.066, 33.068, 34.069, 35.57, 36.573, 37.575, 38.575, 40.078, 40.943]
    y-axis "Memory MiB" 0 --> 1000
    line [24.17, 77.29, 124.03, 143.76, 151.89, 180.7, 201.24, 236.14, 250.09, 231.1, 242.88, 230.95, 232.72, 212.62, 203.34, 188.79, 190.62, 189.16, 194.84, 207.85, 294.73, 315.8, 323.11, 374.98, 493.32, 221.26, 218.75, 226.7, 217.2, 226.4, 209.08, 207.71, 315.11, 358.63, 285.24, 223.68, 199.47, 234.64, 239.64, 0]
    line [22.24, 75.14, 121.9, 141.61, 149.76, 178.73, 199.1, 233.97, 247.92, 228.93, 240.71, 228.78, 230.55, 210.44, 201.17, 185.73, 188.45, 186.98, 192.67, 205.68, 292.57, 313.63, 320.94, 372.92, 491.14, 219.09, 216.99, 224.53, 215.03, 224.23, 206.92, 205.54, 312.94, 356.88, 283.06, 221.5, 197.29, 232.47, 237.51, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.034, 2.036, 3.538, 4.539, 5.54, 6.541, 7.543, 8.043, 9.044, 10.046, 11.047, 12.048, 13.048, 14.551, 15.552, 16.553, 17.554, 18.555, 20.058, 21.059, 22.06, 23.06, 23.562, 24.062, 25.063, 26.564, 27.566, 28.567, 29.567, 30.567, 32.07, 33.071, 34.072, 34.572, 35.072, 36.073, 37.574, 38.575]
    y-axis "CPU percent" 0 --> 200
    line [39.97, 107.85, 85.77, 141.83, 131.84, 109.83, 137.73, 143.9, 109.85, 85.82, 127.91, 13.98, 9.99, 113.87, 77.9, 35.94, 79.9, 43.97, 127.73, 99.94, 115.8, 99.97, 115.69, 139.94, 51.93, 91.92, 79.88, 19.99, 68.01, 15.99, 57.89, 81.91, 91.96, 2, 60.01, 39.98, 77.92, 139.73]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 2.036, 3.538, 4.539, 5.54, 6.541, 7.543, 8.043, 9.044, 10.046, 11.047, 12.048, 13.048, 14.551, 15.552, 16.553, 17.554, 18.555, 20.058, 21.059, 22.06, 23.06, 23.562, 24.062, 25.063, 26.564, 27.566, 28.567, 29.567, 30.567, 32.07, 33.071, 34.072, 34.572, 35.072, 36.073, 37.574, 38.575, 39.221]
    y-axis "Memory MiB" 0 --> 500
    line [23.79, 119.41, 150.03, 188.84, 235.96, 223.94, 227.81, 244.92, 245.7, 231.46, 202.34, 234.14, 215.17, 174.53, 198.93, 200.93, 197.66, 224.03, 206.86, 241.78, 319.98, 333.53, 381.73, 431.99, 342.98, 225.66, 262.02, 225.95, 216.17, 216.61, 218.5, 236.7, 217.14, 214.38, 201.05, 220.69, 212.1, 219.32, 270.27, 0]
    line [22.02, 117.38, 147.99, 186.8, 234.43, 226.28, 225.73, 242.46, 243.74, 229.41, 200.26, 231.69, 213.08, 172.7, 196.87, 198.86, 195.71, 222.41, 204.77, 235.6, 317.9, 331.44, 379.64, 429.94, 340.89, 223.57, 259.95, 223.86, 214.08, 216.53, 216.42, 234.61, 215.06, 212.29, 198.97, 218.6, 209.98, 217.23, 269.7, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.96 s +0.04 s (+0.23%)
Estimated CPU 0.44 s 0.43 s -0.01 s (-2.26%)
Peak PSS 88.42 MiB 88.24 MiB -0.17 MiB (-0.20%)
Peak RSS 90.48 MiB 90.85 MiB +0.37 MiB (+0.41%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 5de83e3e761a → HEAD 1f9fc3c4b11d; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 43.42 s 41.66 s -1.76 s (-4.05%)
Estimated CPU 34.23 s 33.80 s -0.43 s (-1.26%)
Peak PSS 460.50 MiB 466.29 MiB +5.79 MiB (+1.26%)
Peak RSS 462.46 MiB 468.22 MiB +5.76 MiB (+1.25%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.537, 3.538, 4.038, 5.039, 6.04, 7.542, 8.543, 9.544, 11.046, 12.048, 13.549, 14.55, 15.551, 17.053, 18.054, 19.554, 20.555, 22.057, 23.059, 24.06, 25.061, 25.561, 26.563, 28.065, 29.066, 30.068, 31.568, 32.569, 34.07, 35.072, 36.575, 37.575, 38.577, 40.079, 41.079, 42.581]
    y-axis "CPU percent" 0 --> 200
    line [35.96, 107.86, 119.78, 103.88, 167.84, 153.88, 93.9, 102.05, 85.9, 79.86, 73.94, 111.82, 4, 2, 73.94, 91.88, 43.97, 68.01, 101.94, 99.8, 105.89, 101.9, 137.86, 117.9, 57.91, 133.75, 29.96, 29.92, 87.91, 16.01, 95.91, 53.92, 33.93, 32.01, 3.99, 29.96, 117.86, 111.77]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.035, 2.036, 2.537, 3.538, 4.038, 5.039, 6.04, 7.542, 8.543, 9.544, 11.046, 12.048, 13.549, 14.55, 15.551, 17.053, 18.054, 19.554, 20.555, 22.057, 23.059, 24.06, 25.061, 25.561, 26.563, 28.065, 29.066, 30.068, 31.568, 32.569, 34.07, 35.072, 36.575, 37.575, 38.577, 40.079, 41.079, 42.581, 43.42]
    y-axis "Memory MiB" 0 --> 500
    line [23.66, 116.85, 147.09, 182.64, 204.66, 225.83, 244.3, 217.04, 224.67, 214.78, 204.5, 230.67, 214.04, 179.01, 180.24, 196.15, 205.93, 194.55, 225.54, 206.54, 286.38, 331.45, 360.18, 462.46, 244.48, 219.14, 234.08, 221.65, 217.94, 219.72, 225.49, 267.92, 243.99, 207.59, 221.65, 207.93, 215.23, 231.8, 232.14, 0]
    line [21.95, 114.85, 145.08, 180.63, 202.59, 223.82, 242.28, 215.02, 222.65, 212.36, 202.49, 228.64, 211.8, 176.98, 178.21, 194.12, 203.97, 192.53, 223.5, 203.93, 284.45, 329.42, 358.19, 460.5, 242.45, 217.19, 232.05, 219.62, 215.91, 217.69, 223.46, 265.8, 241.96, 205.56, 219.62, 205.9, 213.2, 229.77, 230.11, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.036, 2.537, 3.038, 3.538, 4.539, 6.041, 7.042, 8.042, 9.544, 10.546, 11.547, 13.049, 14.051, 15.052, 16.554, 17.555, 18.556, 20.058, 21.06, 22.061, 23.563, 24.565, 25.567, 26.568, 27.068, 28.069, 29.069, 30.572, 31.572, 32.574, 34.075, 35.077, 36.079, 37.582, 38.583, 39.583, 41.085]
    y-axis "CPU percent" 0 --> 200
    line [37.94, 112.03, 121.78, 99.95, 83.9, 122.02, 111.93, 147.76, 55.93, 127.93, 93.87, 111.87, 3.99, 5.98, 2, 61.93, 99.89, 73.95, 43.96, 65.92, 109.94, 97.8, 113.87, 101.89, 140.02, 127.8, 52.01, 113.92, 19.97, 42.02, 89.85, 21.97, 89.86, 83.82, 65.91, 2, 98.05, 122.03]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.036, 2.537, 3.038, 3.538, 4.539, 6.041, 7.042, 8.042, 9.544, 10.546, 11.547, 13.049, 14.051, 15.052, 16.554, 17.555, 18.556, 20.058, 21.06, 22.061, 23.563, 24.565, 25.567, 26.568, 27.068, 28.069, 29.069, 30.572, 31.572, 32.574, 34.075, 35.077, 36.079, 37.582, 38.583, 39.583, 41.085, 41.661]
    y-axis "Memory MiB" 0 --> 500
    line [23.59, 123.45, 148.91, 178.1, 193.75, 188.79, 232.88, 218.07, 250.27, 232.01, 250.32, 228.7, 209.77, 192.13, 281.7, 223.13, 208.72, 215.91, 214.18, 199.31, 230.77, 206.2, 297.21, 326.29, 360.73, 468.22, 240.22, 218.86, 265.15, 220.52, 217.01, 222.87, 223.05, 265.07, 231.09, 220.32, 198.1, 202.54, 243.55, 0]
    line [21.94, 121.52, 146.97, 176.16, 191.54, 186.83, 230.9, 216.09, 248.38, 231.34, 248.4, 226.72, 207.8, 190.15, 279.72, 221.15, 206.74, 213.93, 212.2, 197.33, 228.79, 204.22, 295.31, 324.31, 358.9, 466.29, 238.24, 216.88, 263.17, 218.54, 215.17, 220.89, 221.07, 263.03, 229.11, 218.35, 196.12, 200.56, 241.6, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.07 s 20.00 s -0.07 s (-0.34%)
Estimated CPU 0.48 s 0.48 s -0.00 s (-0.21%)
Peak PSS 85.25 MiB 89.80 MiB +4.55 MiB (+5.34%)
Peak RSS 87.80 MiB 91.71 MiB +3.90 MiB (+4.44%)
Peak threads 19 18 -1 (-5.26%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is observational: fixture diagnostics and performance deltas never fail the PR. Investigate changes using the complete artifact and controlled repeated runs.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 9e6df3a to 8312510 Compare August 12, 2026 23:09
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor a7c1eb0b42ce → HEAD 8312510607be; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 46.42 s 40.88 s -5.54 s (-11.93%)
Estimated CPU 31.30 s 33.50 s +2.20 s (+7.03%)
Peak PSS 438.24 MiB 418.54 MiB -19.69 MiB (-4.49%)
Peak RSS 440.63 MiB 420.98 MiB -19.66 MiB (-4.46%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 1.536, 2.537, 3.538, 4.039, 4.539, 5.04, 6.542, 8.045, 9.047, 10.547, 11.549, 13.05, 14.052, 15.553, 17.055, 18.056, 19.557, 20.558, 22.06, 23.563, 24.564, 26.066, 27.067, 28.568, 29.569, 31.069, 32.572, 33.571, 35.073, 36.074, 37.576, 39.079, 40.08, 41.581, 42.583, 44.085, 45.086]
    y-axis "CPU percent" 0 --> 200
    line [37.97, 81.9, 121.79, 99.87, 115.86, 159.75, 129.94, 91.83, 97.83, 101.85, 125.82, 23.96, 0, 0, 2, 2, 87.96, 21.99, 2, 29.97, 11.97, 60, 51.95, 113.91, 107.95, 107.93, 136.06, 67.88, 100.06, 17.99, 39.9, 11.98, 79.94, 83.83, 9.99, 63.9, 133.63, 89.92]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 1.536, 2.537, 3.538, 4.039, 4.539, 5.04, 6.542, 8.045, 9.047, 10.547, 11.549, 13.05, 14.052, 15.553, 17.055, 18.056, 19.557, 20.558, 22.06, 23.563, 24.564, 26.066, 27.067, 28.568, 29.569, 31.069, 32.572, 33.571, 35.073, 36.074, 37.576, 39.079, 40.08, 41.581, 42.583, 44.085, 45.086, 46.423]
    y-axis "Memory MiB" 0 --> 500
    line [23.63, 121.57, 135.84, 172.03, 196.04, 216.4, 238.95, 261.58, 248.01, 228.63, 239.79, 235.84, 209.02, 168.72, 167.57, 167.57, 176.79, 212.91, 208.5, 197.75, 180.32, 180.7, 178.07, 195.05, 216.38, 332.27, 335, 440.63, 211.65, 256.94, 209.62, 209.82, 198.29, 216.95, 216.45, 203.66, 214.64, 212.77, 228.29, 0]
    line [21.63, 119.26, 133.54, 169.73, 193.8, 214.1, 237.19, 259.26, 245.69, 226.31, 237.46, 233.23, 206.7, 166.39, 165.24, 165.24, 174.46, 209.97, 206.17, 195.43, 178, 178.37, 175.75, 192.95, 214, 329.86, 332.63, 438.24, 209.25, 254.52, 207.44, 207.42, 195.88, 214.54, 214.13, 201.26, 212.22, 210.36, 226.41, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.537, 3.038, 3.539, 4.54, 5.54, 7.042, 8.044, 9.045, 10.548, 11.55, 12.551, 13.552, 15.054, 15.554, 16.054, 17.056, 18.057, 19.558, 20.558, 21.56, 23.062, 24.064, 25.065, 26.066, 27.569, 28.569, 29.571, 31.073, 32.074, 33.074, 34.075, 35.577, 36.579, 37.581, 38.581, 40.084]
    y-axis "CPU percent" 0 --> 200
    line [39.96, 103.89, 125.77, 93.77, 103.77, 167.75, 160.08, 151.81, 109.82, 135.75, 129.79, 113.78, 65.9, 23.97, 41.89, 0, 4, 87.82, 39.97, 71.93, 125.94, 129.81, 113.94, 101.82, 99.85, 103.84, 145.7, 115.96, 15.98, 89.95, 47.92, 23.97, 118.05, 15.98, 63.88, 2, 97.93, 119.83]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.035, 2.036, 2.537, 3.038, 3.539, 4.54, 5.54, 7.042, 8.044, 9.045, 10.548, 11.55, 12.551, 13.552, 15.054, 15.554, 16.054, 17.056, 18.057, 19.558, 20.558, 21.56, 23.062, 24.064, 25.065, 26.066, 27.569, 28.569, 29.571, 31.073, 32.074, 33.074, 34.075, 35.577, 36.579, 37.581, 38.581, 40.084, 40.883]
    y-axis "Memory MiB" 0 --> 500
    line [23.89, 118.61, 150.57, 171.72, 177.09, 190.43, 224.31, 251.11, 260.61, 233.32, 239.7, 243.76, 221.44, 199.73, 192.66, 184.45, 179.54, 174.33, 176.68, 176.81, 220.55, 212.5, 237.02, 380.83, 362.67, 420.98, 230.78, 237.57, 229.3, 218.21, 219.03, 215.18, 220.65, 242.41, 211.89, 214.93, 184.61, 196.16, 245.57, 0]
    line [21.82, 116.24, 148.3, 169.3, 174.68, 188.02, 221.9, 248.67, 257.93, 230.09, 237.28, 241.33, 219.01, 197.3, 190.23, 182.02, 177.11, 171.9, 174.25, 174.38, 218.11, 210.07, 234.68, 378.41, 360.4, 418.54, 228.35, 235.14, 226.48, 215.78, 216.59, 212.74, 218.22, 239.98, 209.46, 212.5, 182.17, 193.72, 243.15, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.98 s 19.90 s -0.08 s (-0.38%)
Estimated CPU 0.43 s 0.44 s +0.01 s (+2.08%)
Peak PSS 87.13 MiB 86.97 MiB -0.16 MiB (-0.18%)
Peak RSS 89.79 MiB 89.36 MiB -0.43 MiB (-0.48%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

github-actions Bot commented Aug 12, 2026

Copy link
Copy Markdown

Sequential Navigation Soak A/B

✅ HEAD completed the 200-navigation resilience and memory observation.

One browser process, one target, and one CDP session navigate CSDN → SegmentFault → Huaban → example.com repeatedly. This run issued 200 Page.navigate commands per binary.

Common ancestor b1a3d24654 → HEAD 86cb08a27d; benchmark order: head-first; workflow: success.

Session resilience

Metric Base HEAD
Attempted / planned 200 / 200 200 / 200
Direct observable pass 200 / 200 200 / 200
Failures / recovered 0 / 0 0 / 0
Recovery failures 0 0
Lifecycle order violations 0 0
Network order violations 0 0
Wall time 245.2 s 246.3 s

A public-page failure is reported separately from an unrecoverable session. The soak requires all navigation attempts, zero failed recovery, zero lifecycle/network ordering violations, and complete resource evidence.

Process-tree memory

Metric Base HEAD Δ
Boundary samples 200 200 0
Boundary RSS samples 200 200 0
Boundary PSS samples 200 200 0
Periodic peak RSS 293.1 MiB 308.0 MiB +14.9 MiB
Periodic peak PSS 291.6 MiB 306.4 MiB +14.8 MiB
RSS · first 10 avg 203.0 MiB 230.6 MiB +27.6 MiB
RSS · last 10 avg 229.7 MiB 245.1 MiB +15.4 MiB
RSS · last − first window +26.7 MiB +14.5 MiB -12.2 MiB
RSS · warm slope / 100 nav +2.4 MiB +11.1 MiB +8.7 MiB
PSS · first 10 avg 201.4 MiB 227.9 MiB +26.4 MiB
PSS · last 10 avg 228.2 MiB 243.5 MiB +15.3 MiB
PSS · last − first window +26.7 MiB +15.6 MiB -11.1 MiB
PSS · warm slope / 100 nav +2.5 MiB +11.3 MiB +8.9 MiB
Peak file descriptors 56 54 -2
Peak threads 28 28 0

HEAD memory by 50-navigation quarter

HEAD range Avg RSS Final RSS Peak RSS Avg PSS Final PSS Peak FD
1–50 228.0 MiB 199.5 MiB 289.8 MiB 225.8 MiB 197.9 MiB 46
51–100 231.5 MiB 220.2 MiB 297.3 MiB 229.9 MiB 218.5 MiB 43
101–150 238.4 MiB 215.4 MiB 298.8 MiB 236.7 MiB 213.8 MiB 44
151–200 244.1 MiB 229.5 MiB 308.0 MiB 242.6 MiB 227.9 MiB 44

Raw reports and per-navigation boundary samples: workflow run and full sequential-navigation-soak-results artifact.

Public-site timing and memory are observational. Use the A/B deltas and trend shape as evidence, not as a deterministic performance threshold.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor a7c1eb0b42ce → HEAD a752734233c8; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 42.11 s 37.89 s -4.22 s (-10.01%)
Estimated CPU 32.51 s 31.76 s -0.75 s (-2.32%)
Peak PSS 456.78 MiB 462.66 MiB +5.88 MiB (+1.29%)
Peak RSS 459.22 MiB 465.03 MiB +5.80 MiB (+1.26%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 2.539, 3.541, 4.542, 6.045, 7.046, 8.546, 9.547, 10.548, 12.047, 13.049, 14.05, 15.551, 16.553, 17.555, 19.056, 20.057, 21.558, 22.559, 23.56, 24.061, 25.06, 26.061, 26.562, 27.063, 28.563, 29.564, 30.566, 32.068, 33.069, 34.07, 35.571, 36.572, 38.074, 39.075, 40.076, 41.577]
    y-axis "CPU percent" 0 --> 200
    line [39.94, 109.82, 103.8, 65.93, 139.65, 111.79, 139.98, 54, 57.89, 124.02, 0, 79.95, 39.96, 9.99, 4, 33.97, 55.92, 83.92, 110, 105.69, 99.89, 133.95, 133.94, 91.88, 145.75, 69.89, 17.97, 41.96, 89.89, 19.97, 107.89, 111.93, 41.95, 67.86, 77.92, 47.85, 41.96, 123.91]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.036, 2.038, 2.539, 3.541, 4.542, 6.045, 7.046, 8.546, 9.547, 10.548, 12.047, 13.049, 14.05, 15.551, 16.553, 17.555, 19.056, 20.057, 21.558, 22.559, 23.56, 24.061, 25.06, 26.061, 26.562, 27.063, 28.563, 29.564, 30.566, 32.068, 33.069, 34.07, 35.571, 36.572, 38.074, 39.075, 40.076, 41.577, 42.112]
    y-axis "Memory MiB" 0 --> 500
    line [23.68, 126.13, 149.5, 171.91, 182.92, 256.36, 219.93, 266.11, 208.61, 238.89, 253.57, 211.98, 191.4, 195.82, 190.68, 177.54, 181.87, 194.76, 211.58, 326.77, 340.67, 409, 459.22, 231.59, 221.6, 230.14, 261.39, 217.51, 216.11, 219.64, 222.6, 284.34, 346.21, 235.85, 233.95, 242.77, 216.26, 207.7, 253.93, 0]
    line [21.63, 123.68, 147.06, 169.47, 180.65, 253.92, 217.49, 263.67, 206.17, 236.46, 251.11, 209.5, 188.93, 193.12, 188.2, 175.06, 179.4, 192.61, 208.98, 324.29, 338.36, 406.53, 456.78, 229.11, 218.11, 227.66, 258.92, 215.03, 213.64, 217.09, 220.12, 280.18, 343.74, 233.37, 231.48, 240.29, 213.78, 205.29, 251.5, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.038, 4.038, 5.04, 5.54, 6.041, 6.542, 7.544, 8.545, 9.547, 10.547, 11.549, 12.55, 13.552, 14.553, 15.054, 16.056, 17.058, 18.06, 19.06, 20.062, 21.064, 22.065, 23.066, 24.568, 25.569, 26.571, 27.573, 28.574, 29.575, 30.577, 31.578, 32.579, 34.08, 35.081, 36.082, 37.083]
    y-axis "CPU percent" 0 --> 200
    line [37.97, 103.93, 96, 151.91, 145.88, 141.85, 103.88, 171.5, 75.9, 111.67, 127.83, 71.9, 63.93, 61.9, 5.99, 0, 3.99, 2, 113.73, 73.87, 72.03, 101.8, 109.91, 101.92, 137.79, 43.98, 127.8, 97.72, 21.96, 71.9, 3.99, 51.92, 139.9, 111.8, 61.99, 104.03, 23.97, 113.88]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.036, 2.037, 3.038, 4.038, 5.04, 5.54, 6.041, 6.542, 7.544, 8.545, 9.547, 10.547, 11.549, 12.55, 13.552, 14.553, 15.054, 16.056, 17.058, 18.06, 19.06, 20.062, 21.064, 22.065, 23.066, 24.568, 25.569, 26.571, 27.573, 28.574, 29.575, 30.577, 31.578, 32.579, 34.08, 35.081, 36.082, 37.083, 37.894]
    y-axis "Memory MiB" 0 --> 500
    line [24.07, 124.8, 152.12, 185.86, 217.77, 217.38, 225.14, 220.07, 239.56, 211.81, 236.61, 251.15, 222.77, 216.78, 187.6, 186.3, 176.41, 173.93, 173.48, 225.02, 207.7, 226.95, 297.46, 329.53, 377.76, 465.03, 208.52, 260.04, 224.48, 209.97, 213.95, 212.02, 225.14, 277.24, 245.48, 235.26, 242.29, 223.82, 245.53, 0]
    line [22.03, 122.5, 149.82, 182.69, 215.47, 215.01, 222.78, 217.71, 237.19, 210.15, 234.25, 248.81, 220.4, 214.42, 185.23, 183.97, 174.03, 171.54, 171.09, 222.64, 205.29, 226.09, 295.18, 327.14, 375.42, 462.66, 206.14, 258.02, 221.95, 207.59, 211.56, 209.64, 222.76, 274.86, 243.09, 232.87, 239.9, 221.4, 244.65, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.93 s 19.91 s -0.02 s (-0.10%)
Estimated CPU 0.44 s 0.42 s -0.02 s (-4.52%)
Peak PSS 87.90 MiB 88.88 MiB +0.98 MiB (+1.12%)
Peak RSS 90.21 MiB 91.30 MiB +1.09 MiB (+1.21%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch 4 times, most recently from ffaf1ca to 685c955 Compare August 13, 2026 05:17
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor d41bf8ff9b1d → HEAD 685c95567069; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 44.16 s 46.28 s +2.12 s (+4.80%)
Estimated CPU 32.29 s 41.70 s +9.41 s (+29.13%)
Peak PSS 463.34 MiB 481.96 MiB +18.63 MiB (+4.02%)
Peak RSS 465.53 MiB 494.70 MiB +29.17 MiB (+6.27%)
Peak threads 27 28 +1 (+3.70%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.538, 3.54, 4.542, 5.043, 5.543, 6.043, 7.546, 8.548, 10.05, 11.051, 12.052, 12.553, 13.555, 15.056, 16.058, 17.559, 18.56, 20.062, 21.063, 22.565, 23.566, 24.566, 26.069, 27.071, 28.573, 29.574, 31.074, 32.076, 33.577, 34.577, 36.079, 37.08, 38.583, 39.584, 41.086, 42.087, 43.588]
    y-axis "CPU percent" 0 --> 200
    line [25.98, 123.82, 97.84, 157.74, 129.88, 135.85, 135.9, 137.76, 55.91, 83.88, 129.82, 0, 3.99, 69.84, 79.95, 11.97, 2, 2, 6, 0, 79.94, 91.88, 100.06, 107.77, 137.72, 37.95, 121.92, 113.99, 11.98, 69.96, 43.95, 35.9, 121.96, 61.88, 2, 57.96, 31.98, 123.87]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.538, 3.54, 4.542, 5.043, 5.543, 6.043, 7.546, 8.548, 10.05, 11.051, 12.052, 12.553, 13.555, 15.056, 16.058, 17.559, 18.56, 20.062, 21.063, 22.565, 23.566, 24.566, 26.069, 27.071, 28.573, 29.574, 31.074, 32.076, 33.577, 34.577, 36.079, 37.08, 38.583, 39.584, 41.086, 42.087, 43.588, 44.163]
    y-axis "Memory MiB" 0 --> 500
    line [24, 122.14, 171.26, 191.54, 241.01, 249.95, 220.59, 222.89, 245.54, 224.57, 213.38, 218.87, 196.68, 172.42, 192.5, 199, 194.52, 191.28, 187.2, 189.35, 194.71, 206.71, 210.37, 284.78, 338.8, 465.53, 211, 247.39, 252.11, 230.46, 217.46, 218.41, 233.3, 299.36, 238.95, 219.59, 226.13, 214.92, 252.8, 0]
    line [22.06, 119.84, 169.08, 189.32, 238.26, 247.74, 218.39, 220.64, 243.35, 222.41, 211.18, 216.8, 194.47, 170.21, 190.29, 196.79, 192.31, 189.07, 184.99, 187.14, 192.5, 204.51, 208.45, 282.65, 336.82, 463.34, 208.8, 245.18, 249.91, 228.26, 215.26, 216.21, 230.63, 297.46, 236.75, 217.39, 223.93, 212.71, 250.11, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 1.538, 2.54, 3.54, 4.041, 5.042, 6.044, 6.544, 8.046, 9.047, 10.547, 11.548, 13.05, 14.052, 15.554, 17.057, 18.058, 19.56, 20.562, 22.063, 23.565, 24.566, 26.068, 27.069, 28.57, 29.572, 31.073, 32.574, 33.575, 35.077, 36.079, 37.581, 39.082, 40.083, 41.585, 42.586, 44.088, 45.089]
    y-axis "CPU percent" 0 --> 200
    line [37.98, 109.93, 127.7, 121.96, 97.84, 147.87, 119.84, 181.78, 129.9, 163.78, 70.01, 79.91, 125.88, 87.84, 77.87, 107.72, 11.98, 103.89, 49.91, 123.95, 113.85, 137.97, 105.93, 141.76, 66, 127.84, 63.91, 76.05, 75.9, 75.92, 129.69, 115.94, 2, 0, 2, 53.92, 35.95, 111.85]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 1.538, 2.54, 3.54, 4.041, 5.042, 6.044, 6.544, 8.046, 9.047, 10.547, 11.548, 13.05, 14.052, 15.554, 17.057, 18.058, 19.56, 20.562, 22.063, 23.565, 24.566, 26.068, 27.069, 28.57, 29.572, 31.073, 32.574, 33.575, 35.077, 36.079, 37.581, 39.082, 40.083, 41.585, 42.586, 44.088, 45.089, 46.282]
    y-axis "Memory MiB" 0 --> 1000
    line [24.06, 119.34, 140.48, 149.9, 196.04, 192.04, 211.68, 233.67, 240.63, 214.88, 255.25, 226.99, 244.68, 258.1, 255.02, 242.75, 248.47, 225.69, 255.67, 223.56, 242.94, 352.16, 314.99, 354.61, 494.7, 211.78, 224.77, 216.98, 222.56, 209.11, 231.63, 352.8, 230.55, 215.76, 213.27, 220.31, 217.72, 200.92, 229.97, 0]
    line [22.13, 117.15, 138.29, 147.71, 193.26, 189.82, 209.46, 231.45, 238.39, 212.63, 253, 224.8, 242.43, 255.86, 252.74, 240.61, 246.22, 223.44, 253.43, 221.32, 240.77, 349.89, 312.72, 352.56, 481.96, 209.51, 226.35, 214.71, 220.29, 206.83, 229.36, 350.52, 225.54, 213.5, 211, 218.06, 215.46, 198.48, 227.48, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.07 s 20.01 s -0.05 s (-0.27%)
Estimated CPU 0.47 s 0.46 s -0.01 s (-2.33%)
Peak PSS 87.80 MiB 88.65 MiB +0.85 MiB (+0.97%)
Peak RSS 90.16 MiB 90.79 MiB +0.63 MiB (+0.69%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch 2 times, most recently from 67820bb to 654d9d3 Compare August 13, 2026 05:49
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 48742bb65765 → HEAD 654d9d379b3c; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 48.11 s 39.83 s -8.27 s (-17.20%)
Estimated CPU 35.61 s 32.55 s -3.06 s (-8.58%)
Peak PSS 467.09 MiB 447.85 MiB -19.25 MiB (-4.12%)
Peak RSS 469.38 MiB 450.03 MiB -19.35 MiB (-4.12%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 1.536, 2.537, 3.038, 4.04, 5.543, 7.044, 8.546, 9.547, 11.051, 12.554, 14.055, 15.057, 16.559, 18.062, 19.563, 21.065, 22.065, 23.567, 25.067, 26.567, 27.567, 28.068, 29.069, 30.572, 32.072, 33.572, 34.573, 36.074, 37.579, 39.084, 40.088, 41.588, 43.091, 44.592, 45.594, 47.095, 48.095]
    y-axis "CPU percent" 0 --> 200
    line [61.95, 61.92, 3.99, 0, 109.84, 67.83, 105.87, 101.83, 161.77, 33.99, 127.84, 139.94, 53.95, 7.97, 59.92, 13.99, 17.99, 117.93, 105.93, 111.89, 109.99, 101.98, 121.86, 129.92, 89.95, 126, 18.01, 73.9, 9.99, 0, 117.85, 99.85, 50.02, 55.9, 141.8, 17.97, 163.75, 59.97]
Loading
xychart-beta
    title "Base memory: RSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 1.536, 2.537, 3.038, 4.04, 5.543, 7.044, 8.546, 9.547, 11.051, 12.554, 14.055, 15.057, 16.559, 18.062, 19.563, 21.065, 22.065, 23.567, 25.067, 26.567, 27.567, 28.068, 29.069, 30.572, 32.072, 33.572, 34.573, 36.074, 37.579, 39.084, 40.088, 41.588, 43.091, 44.592, 45.594, 47.095, 48.095, 48.109]
    y-axis "Memory MiB" 0 --> 500
    line [23.91, 122.35, 136.13, 129.91, 129.91, 150.91, 187.45, 244.31, 216.38, 250.13, 235.24, 232.3, 247.76, 202.46, 187.88, 202.79, 190.52, 182.83, 229.89, 202.7, 231.81, 303.98, 380.5, 469.38, 230.41, 230.98, 237.7, 210.04, 209.24, 216.92, 192.21, 298.96, 356.62, 252.21, 233.14, 240.07, 214.9, 291.62, 0, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.038, 3.538, 4.038, 4.539, 5.54, 6.541, 8.043, 9.046, 10.047, 11.049, 12.051, 13.553, 14.555, 15.556, 16.557, 18.06, 19.062, 20.064, 21.065, 22.067, 23.068, 23.568, 24.569, 25.57, 26.572, 28.072, 29.074, 30.076, 31.078, 32.08, 33.58, 34.58, 35.58, 36.582, 38.085, 39.087]
    y-axis "CPU percent" 0 --> 200
    line [57.84, 81.9, 109.87, 93.97, 126.02, 147.88, 73.89, 107.87, 163.81, 103.84, 107.89, 101.83, 97.77, 71.9, 101.75, 13.98, 55.93, 75.93, 141.77, 99.8, 115.89, 101.7, 135.94, 131.92, 80, 113.97, 107.68, 33.99, 77.86, 5.99, 43.9, 97.78, 12, 8, 0, 0, 27.92, 117.65]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.036, 2.037, 3.038, 3.538, 4.038, 4.539, 5.54, 6.541, 8.043, 9.046, 10.047, 11.049, 12.051, 13.553, 14.555, 15.556, 16.557, 18.06, 19.062, 20.064, 21.065, 22.067, 23.068, 23.568, 24.569, 25.57, 26.572, 28.072, 29.074, 30.076, 31.078, 32.08, 33.58, 34.58, 35.58, 36.582, 38.085, 39.087, 39.834]
    y-axis "Memory MiB" 0 --> 500
    line [23.21, 123.23, 147.67, 178.75, 174.56, 190.19, 226.8, 241.32, 217.79, 253.25, 225.4, 231.28, 231.71, 216.67, 213.08, 219.21, 198.83, 198, 210.26, 235.13, 296.6, 313.08, 379.71, 450.03, 243.04, 218.98, 261.68, 262, 244, 246.39, 244.45, 246.59, 254.89, 237.02, 246.25, 242.9, 242.18, 208.5, 246.55, 0]
    line [21.26, 121, 145.47, 176.58, 172.38, 188.03, 224.63, 239.12, 215.59, 251.05, 223.2, 229.08, 229.43, 214.48, 210.89, 217.01, 196.62, 195.87, 208.05, 232.93, 294.48, 310.87, 377.54, 447.85, 240.83, 216.78, 259.51, 259.88, 241.8, 244.2, 242.27, 244.38, 252.68, 234.82, 244.04, 240.7, 239.98, 206.31, 244.35, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.92 s +0.00 s (+0.01%)
Estimated CPU 0.45 s 0.42 s -0.03 s (-6.64%)
Peak PSS 88.10 MiB 88.40 MiB +0.30 MiB (+0.34%)
Peak RSS 90.06 MiB 90.56 MiB +0.50 MiB (+0.56%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 654d9d3 to 7588b94 Compare August 13, 2026 07:32
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 62782add590a → HEAD 7588b94e6521; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 8; HTTP error + empty: 1; snapshot error + empty: 2 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 51.39 s 43.88 s -7.51 s (-14.61%)
Estimated CPU 38.65 s 36.27 s -2.38 s (-6.15%)
Peak PSS 453.86 MiB 420.54 MiB -33.32 MiB (-7.34%)
Peak RSS 456.12 MiB 422.62 MiB -33.50 MiB (-7.35%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.55, 2.551, 3.051, 4.552, 5.553, 7.055, 8.579, 10.154, 11.655, 13.158, 14.661, 15.663, 17.164, 17.665, 18.667, 20.169, 21.671, 23.173, 24.674, 26.175, 27.176, 28.678, 30.181, 31.683, 33.185, 34.685, 36.187, 37.189, 38.69, 40.193, 41.695, 43.196, 44.698, 46.201, 47.202, 48.702, 50.204, 50.703]
    y-axis "CPU percent" 0 --> 200
    line [83.88, 127.8, 103.99, 131.84, 153.79, 91.88, 13.97, 111.38, 118.09, 140.02, 1.99, 4, 2, 0, 75.9, 107.86, 49.87, 61.92, 117.85, 99.8, 125.85, 111.77, 141.77, 77.96, 136.02, 118.02, 75.87, 19.94, 78.03, 103.83, 4, 37.97, 2, 6, 5.99, 39.96, 123.9, 160.06]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.049, 1.55, 2.551, 3.051, 4.552, 5.553, 7.055, 8.579, 10.154, 11.655, 13.158, 14.661, 15.663, 17.164, 17.665, 18.667, 20.169, 21.671, 23.173, 24.674, 26.175, 27.176, 28.678, 30.181, 31.683, 33.185, 34.685, 36.187, 37.189, 38.69, 40.193, 41.695, 43.196, 44.698, 46.201, 47.202, 48.702, 50.204, 50.703, 51.39]
    y-axis "Memory MiB" 0 --> 500
    line [21.29, 131.78, 178.08, 189.39, 222.03, 218.06, 237.32, 222.92, 213.86, 235.54, 251.97, 207.82, 207.02, 207.42, 206.36, 220.13, 224.21, 196.32, 222.89, 207.14, 299.86, 300.57, 333.39, 456.12, 232.88, 239, 238.27, 206.29, 197.54, 216.57, 337.59, 214.08, 213.48, 195.79, 192.71, 199.69, 187.73, 234.85, 280.84, 0]
    line [19.33, 129.6, 175.9, 187.2, 219.32, 215.67, 234.85, 220.44, 211.37, 233.08, 249.61, 205.63, 204.82, 205.22, 204.16, 217.84, 222.02, 195.65, 220.69, 204.94, 297.77, 298.37, 331.19, 453.86, 230.58, 236.81, 236.09, 204.11, 195.36, 214.39, 335.41, 211.9, 211.3, 193.61, 190.53, 197.69, 185.55, 232.67, 278.67, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.036, 2.536, 3.537, 4.539, 5.039, 6.04, 7.543, 8.544, 10.045, 11.047, 12.049, 13.051, 13.552, 14.554, 16.057, 17.057, 18.558, 19.559, 21.061, 22.062, 23.063, 24.566, 25.568, 27.07, 28.071, 29.572, 30.572, 32.073, 33.073, 34.074, 35.576, 36.577, 38.079, 39.081, 40.582, 41.584, 43.086]
    y-axis "CPU percent" 0 --> 200
    line [53.93, 0, 34, 121.94, 83.87, 133.83, 127.86, 117.83, 113.98, 0, 61.92, 95.83, 147.68, 103.78, 73.86, 3.99, 2, 64, 23.99, 55.92, 37.94, 123.8, 101.81, 99.76, 99.69, 141.88, 42.01, 130.01, 33.97, 89.88, 53.93, 47.91, 109.9, 129.91, 71.84, 47.98, 123.77, 117.8]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.036, 2.536, 3.537, 4.539, 5.039, 6.04, 7.543, 8.544, 10.045, 11.047, 12.049, 13.051, 13.552, 14.554, 16.057, 17.057, 18.558, 19.559, 21.061, 22.062, 23.063, 24.566, 25.568, 27.07, 28.071, 29.572, 30.572, 32.073, 33.073, 34.074, 35.576, 36.577, 38.079, 39.081, 40.582, 41.584, 43.086, 43.879]
    y-axis "Memory MiB" 0 --> 500
    line [21.74, 118.38, 128.87, 136.96, 181.32, 193.21, 209.81, 239.14, 216.59, 229.32, 203.95, 196.94, 243.23, 263.24, 229.66, 223.48, 222.88, 219.41, 231.71, 209.74, 204.03, 232.71, 218.1, 223.88, 302.76, 351.99, 422.62, 204.3, 239.67, 211.96, 203.68, 195.88, 203, 320.95, 238.36, 240.82, 214.09, 203.8, 239.18, 0]
    line [19.9, 116.26, 126.75, 134.83, 178.91, 191.09, 207.69, 237.04, 221.89, 227.19, 201.83, 194.84, 241.03, 261.11, 227.52, 221.34, 220.74, 217.27, 229.57, 207.6, 201.89, 217.3, 215.84, 221.73, 300.75, 350.11, 420.54, 202.17, 237.54, 209.82, 201.36, 193.73, 200.86, 319.09, 236.22, 238.67, 211.86, 201.58, 237.01, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.98 s 19.93 s -0.05 s (-0.27%)
Estimated CPU 0.57 s 0.43 s -0.14 s (-24.34%)
Peak PSS 88.39 MiB 83.16 MiB -5.24 MiB (-5.92%)
Peak RSS 90.46 MiB 85.30 MiB -5.16 MiB (-5.71%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 62782add590a → HEAD dbddb66116ba; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 45.44 s 39.82 s -5.62 s (-12.37%)
Estimated CPU 35.48 s 34.98 s -0.51 s (-1.43%)
Peak PSS 446.84 MiB 454.40 MiB +7.55 MiB (+1.69%)
Peak RSS 449.19 MiB 456.02 MiB +6.84 MiB (+1.52%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 1.537, 2.538, 4.039, 5.041, 6.543, 7.545, 9.047, 10.049, 11.549, 12.551, 14.052, 15.053, 16.556, 17.557, 19.058, 20.059, 21.561, 23.061, 24.063, 25.564, 26.565, 28.067, 28.568, 29.068, 30.57, 31.572, 32.073, 33.073, 34.075, 35.577, 36.578, 38.081, 39.081, 40.582, 41.583, 43.084, 44.086]
    y-axis "CPU percent" 0 --> 200
    line [47.86, 81.9, 112.04, 71.98, 97.79, 0, 117.87, 93.91, 139.82, 109.96, 81.93, 102.02, 105.78, 12, 19.98, 49.99, 27.95, 79.89, 52.03, 121.71, 97.99, 113.9, 115.85, 125.88, 115.89, 101.86, 131.76, 157.63, 95.95, 75.9, 7.99, 15.98, 55.89, 88.05, 0, 0, 55.99, 75.9]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.037, 1.537, 2.538, 4.039, 5.041, 6.543, 7.545, 9.047, 10.049, 11.549, 12.551, 14.052, 15.053, 16.556, 17.557, 19.058, 20.059, 21.561, 23.061, 24.063, 25.564, 26.565, 28.067, 28.568, 29.068, 30.57, 31.572, 32.073, 33.073, 34.075, 35.577, 36.578, 38.081, 39.081, 40.582, 41.583, 43.084, 44.086, 45.441]
    y-axis "Memory MiB" 0 --> 500
    line [23.49, 122.09, 136.15, 152.03, 179.06, 221.11, 222.99, 250.08, 221.65, 214.19, 202.49, 206.45, 263.9, 255.93, 237.71, 231, 234.89, 220.59, 254.43, 221.98, 215.25, 294.8, 319.59, 428.42, 449.19, 238.71, 216.36, 284.17, 283.75, 230.48, 227.86, 207.24, 204.21, 222.8, 223.1, 203.61, 212, 205.07, 207.79, 0]
    line [21.4, 119.67, 133.74, 149.63, 176.67, 218.69, 220.57, 247.64, 219.36, 211.75, 200.06, 204, 261.45, 253.46, 235.26, 229.08, 232.58, 218.14, 252.02, 219.57, 212.84, 292.39, 317.17, 426.02, 446.84, 236.28, 214.09, 282.26, 281.33, 228.01, 225.49, 204.88, 201.84, 216.94, 220.7, 201.19, 209.48, 202.56, 205.27, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.041, 2.043, 3.043, 3.544, 4.545, 5.547, 6.548, 8.049, 9.052, 10.054, 11.055, 12.055, 13.557, 14.558, 15.559, 16.56, 18.062, 19.064, 20.066, 21.067, 22.069, 23.57, 24.572, 25.073, 25.574, 26.576, 28.077, 29.078, 30.079, 31.081, 32.082, 33.585, 34.586, 35.587, 36.087, 36.588, 38.09, 39.091]
    y-axis "CPU percent" 0 --> 200
    line [45.96, 65.9, 111.99, 99.92, 169.71, 123.71, 129.83, 165.7, 103.79, 129.61, 117.92, 94.01, 69.94, 41.95, 8, 43.96, 19.97, 89.9, 93.87, 105.8, 125.77, 103.84, 113.93, 133.9, 115.74, 47.9, 119.8, 43.93, 71.92, 43.93, 37.95, 69.86, 15.98, 57.94, 0, 61.95, 39.96, 111.84]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.041, 1.041, 2.043, 3.043, 3.544, 4.545, 5.547, 6.548, 8.049, 9.052, 10.054, 11.055, 12.055, 13.557, 14.558, 15.559, 16.56, 18.062, 19.064, 20.066, 21.067, 22.069, 23.57, 24.572, 25.073, 25.574, 26.576, 28.077, 29.078, 30.079, 31.081, 32.082, 33.585, 34.586, 35.587, 36.087, 36.588, 38.09, 39.091, 39.82]
    y-axis "Memory MiB" 0 --> 500
    line [23.16, 123.73, 145.43, 189.83, 188.95, 234.72, 235.79, 220.95, 238.29, 225.46, 240.13, 249.63, 230.43, 208.48, 192.05, 189.72, 184.95, 196.4, 202, 231.47, 322.73, 318.09, 347.92, 417.43, 456.02, 227.54, 213.1, 248.91, 217.09, 208.5, 200.74, 213.09, 204.89, 191.31, 200.14, 199.32, 186.49, 199.9, 246.52, 0]
    line [21.05, 121.28, 142.98, 187.44, 186.5, 232.27, 233.33, 218.51, 235.69, 216.9, 237.7, 247.17, 227.96, 206.02, 189.59, 187.26, 182.48, 193.94, 199.54, 229.52, 320.36, 315.63, 345.71, 415.47, 454.4, 225.08, 210.64, 246.45, 214.64, 206.03, 198.28, 210.63, 202.77, 188.85, 197.68, 196.86, 184.03, 197.44, 244.06, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.93 s 19.93 s -0.00 s (0.00%)
Estimated CPU 0.47 s 0.44 s -0.03 s (-6.36%)
Peak PSS 88.48 MiB 88.49 MiB +0.01 MiB (+0.01%)
Peak RSS 90.80 MiB 90.79 MiB -0.02 MiB (-0.02%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD ce249c263dd0; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 43.96 s 37.60 s -6.35 s (-14.46%)
Estimated CPU 32.85 s 33.95 s +1.10 s (+3.35%)
Peak PSS 338.27 MiB 347.95 MiB +9.68 MiB (+2.86%)
Peak RSS 340.57 MiB 350.08 MiB +9.51 MiB (+2.79%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.539, 3.54, 4.541, 5.041, 6.043, 7.543, 8.544, 10.046, 11.047, 12.048, 13.55, 14.552, 16.054, 17.055, 18.558, 19.559, 21.061, 22.062, 23.064, 24.565, 25.567, 27.07, 28.07, 29.57, 30.572, 32.075, 32.575, 33.075, 34.077, 35.58, 36.581, 37.583, 38.084, 39.084, 40.587, 41.589, 43.09]
    y-axis "CPU percent" 0 --> 200
    line [59.89, 101.83, 115.89, 33.96, 145.98, 137.84, 132.09, 115.82, 123.86, 95.92, 91.95, 2, 13.97, 107.69, 41.97, 37.91, 107.79, 109.85, 175.75, 109.8, 60, 151.56, 119.71, 31.99, 77.99, 19.96, 125.68, 132.07, 103.88, 107.71, 35.94, 5.99, 0, 67.93, 2, 2, 47.87, 113.88]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.539, 3.54, 4.541, 5.041, 6.043, 7.543, 8.544, 10.046, 11.047, 12.048, 13.55, 14.552, 16.054, 17.055, 18.558, 19.559, 21.061, 22.062, 23.064, 24.565, 25.567, 27.07, 28.07, 29.57, 30.572, 32.075, 32.575, 33.075, 34.077, 35.58, 36.581, 37.583, 38.084, 39.084, 40.587, 41.589, 43.09, 43.96]
    y-axis "Memory MiB" 0 --> 500
    line [23.02, 119.37, 164.99, 204.45, 233.19, 233.83, 222.38, 224.68, 221.34, 233.29, 220.82, 207.82, 192.73, 190.89, 201.49, 181.5, 183.15, 227.36, 199.72, 214.27, 265.95, 191.11, 215.66, 245.42, 225.32, 221.73, 236.92, 288.81, 340.57, 334.23, 213.77, 207.49, 180.17, 205.11, 206.35, 202.35, 192, 190.16, 230.59, 0]
    line [20.99, 117.09, 162.71, 202.18, 230.91, 231.5, 220.04, 222.34, 219.01, 230.96, 220.84, 205.49, 186.22, 188.56, 199.16, 179.17, 180.68, 224.98, 197.39, 213.94, 263.62, 188.9, 213.36, 243.18, 223.02, 219.4, 234.59, 286.48, 338.27, 331.95, 211.45, 205.16, 177.84, 202.77, 204.02, 200.02, 189.67, 187.83, 228.41, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.038, 4.041, 5.042, 5.543, 6.044, 6.544, 7.545, 8.547, 9.548, 10.55, 11.551, 12.552, 13.552, 15.054, 16.056, 17.056, 18.057, 19.058, 20.059, 21.061, 22.062, 23.063, 24.563, 25.563, 26.564, 27.566, 28.567, 29.569, 30.07, 30.571, 31.572, 32.573, 34.075, 35.076, 36.077, 37.079]
    y-axis "CPU percent" 0 --> 500
    line [23.98, 103.89, 91.79, 117.66, 191.71, 167.78, 177.79, 165.99, 117.8, 133.78, 95.87, 77.83, 55.96, 108.04, 124.05, 29.97, 99.92, 111.89, 49.94, 55.97, 23.98, 99.91, 99.84, 138.05, 118.03, 63.96, 115.83, 47.98, 81.88, 47.93, 3.99, 35.96, 93.85, 72.01, 19.98, 133.83, 67.94, 131.83]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.038, 4.041, 5.042, 5.543, 6.044, 6.544, 7.545, 8.547, 9.548, 10.55, 11.551, 12.552, 13.552, 15.054, 16.056, 17.056, 18.057, 19.058, 20.059, 21.061, 22.062, 23.063, 24.563, 25.563, 26.564, 27.566, 28.567, 29.569, 30.07, 30.571, 31.572, 32.573, 34.075, 35.076, 36.077, 37.079, 37.605]
    y-axis "Memory MiB" 0 --> 500
    line [22.95, 111.88, 150.62, 189.92, 220.51, 259.83, 328.39, 327.07, 350.08, 339.91, 316.58, 324, 327.95, 303.33, 207.54, 233.89, 204.25, 219.07, 213.73, 198.42, 224.71, 191.51, 206.8, 250.44, 255.09, 211.18, 206.37, 240.59, 207.93, 199.33, 197.48, 201.15, 210.11, 203.86, 220.97, 203.65, 203.11, 202.99, 251.38, 0]
    line [21.01, 109.66, 148.39, 187.84, 218.27, 257.64, 326.07, 325, 347.95, 337.53, 314.35, 321.75, 325.7, 301.08, 205.29, 231.47, 202, 217.33, 211.48, 196.17, 217.06, 189.27, 204.56, 247.93, 252.85, 208.93, 204.12, 238.35, 205.69, 197.1, 195.23, 198.9, 207.45, 201.63, 218.72, 201.4, 200.87, 200.75, 249.13, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.92 s -0.00 s (-0.01%)
Estimated CPU 0.46 s 0.46 s 0.00 s (0.00%)
Peak PSS 88.10 MiB 87.81 MiB -0.29 MiB (-0.33%)
Peak RSS 90.29 MiB 90.15 MiB -0.14 MiB (-0.16%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD 99491f5cc535; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 36.44 s 39.33 s +2.88 s (+7.92%)
Estimated CPU 31.18 s 30.74 s -0.44 s (-1.41%)
Peak PSS 278.25 MiB 361.06 MiB +82.81 MiB (+29.76%)
Peak RSS 280.40 MiB 363.27 MiB +82.88 MiB (+29.56%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.038, 2.038, 3.039, 4.042, 4.542, 5.044, 6.045, 7.045, 8.047, 9.049, 10.05, 10.55, 11.051, 12.053, 13.056, 14.056, 15.057, 16.058, 17.058, 18.559, 19.56, 20.561, 21.563, 22.563, 23.563, 24.565, 25.568, 26.569, 27.57, 28.571, 29.572, 30.574, 31.575, 32.076, 32.576, 33.578, 34.58, 35.581]
    y-axis "CPU percent" 0 --> 200
    line [57.99, 82.06, 105.79, 139.66, 181.81, 103.69, 141.85, 145.85, 25.95, 63.85, 88.04, 111.91, 125.72, 101.81, 63.82, 52, 6, 27.98, 25.99, 29.96, 117.89, 169.83, 109.67, 136.05, 95.89, 135.66, 81.86, 89.88, 73.94, 19.97, 113.84, 65.89, 16, 3.99, 50.01, 117.67, 31.91, 113.89]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.038, 1.038, 2.038, 3.039, 4.042, 4.542, 5.044, 6.045, 7.045, 8.047, 9.049, 10.05, 10.55, 11.051, 12.053, 13.056, 14.056, 15.057, 16.058, 17.058, 18.559, 19.56, 20.561, 21.563, 22.563, 23.563, 24.565, 25.568, 26.569, 27.57, 28.571, 29.572, 30.574, 31.575, 32.076, 32.576, 33.578, 34.58, 35.581, 36.441]
    y-axis "Memory MiB" 0 --> 500
    line [23.13, 120.01, 145.77, 192.35, 207.47, 225.61, 247.12, 243.99, 260.32, 258.52, 226.45, 245.93, 280.4, 272.46, 251.1, 184.4, 197.08, 191.82, 187.61, 186.31, 212.08, 196.28, 215.29, 269.32, 232.2, 213.96, 270.68, 208.04, 214.07, 193.49, 204.06, 263.82, 228.04, 216.05, 200.9, 208.01, 228.33, 208.38, 233.63, 0]
    line [21.11, 117.73, 143.51, 190.08, 202.71, 223.33, 244.56, 241.77, 258.28, 256.24, 224.16, 243.31, 278.25, 269.9, 248.81, 182.11, 194.8, 189.54, 185.32, 184.02, 209.79, 193.99, 213.66, 267.04, 229.91, 211.67, 268.4, 205.75, 211.78, 191.2, 201.82, 261.54, 225.75, 213.76, 198.61, 205.72, 226.05, 206.57, 231.7, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 3.039, 3.54, 4.041, 4.541, 5.543, 6.544, 7.545, 9.047, 10.048, 11.05, 12.052, 13.054, 14.557, 15.559, 16.56, 17.561, 18.563, 20.066, 21.068, 22.069, 23.07, 24.072, 25.073, 26.576, 27.576, 28.578, 29.579, 30.581, 31.581, 32.082, 33.084, 34.085, 35.086, 36.086, 37.587, 38.589]
    y-axis "CPU percent" 0 --> 200
    line [45.85, 0, 105.87, 125.76, 107.96, 59.95, 167.89, 139.78, 125.84, 80.02, 41.93, 47.9, 137.8, 79.86, 19.94, 59.96, 49.99, 15.98, 41.87, 23.94, 103.86, 107.87, 127.9, 57.92, 115.85, 83.83, 98.04, 43.92, 23.97, 85.88, 131.81, 103.88, 87.9, 67.92, 4, 30, 45.92, 109.71]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.037, 2.038, 3.039, 3.54, 4.041, 4.541, 5.543, 6.544, 7.545, 9.047, 10.048, 11.05, 12.052, 13.054, 14.557, 15.559, 16.56, 17.561, 18.563, 20.066, 21.068, 22.069, 23.07, 24.072, 25.073, 26.576, 27.576, 28.578, 29.579, 30.581, 31.581, 32.082, 33.084, 34.085, 35.086, 36.086, 37.587, 38.589, 39.326]
    y-axis "Memory MiB" 0 --> 500
    line [22.76, 121.9, 131.55, 147.44, 171.08, 193.89, 182.03, 232.51, 255.44, 212.32, 224.82, 223.51, 235.76, 252.18, 223.1, 216.02, 231.44, 221.08, 213.09, 206.93, 208.11, 213.73, 256.8, 211.98, 212.33, 233.04, 216.28, 210.5, 203.04, 216.68, 217.16, 363.27, 351.86, 262.64, 255.27, 236.71, 246.14, 236.51, 269.56, 0]
    line [20.83, 119.68, 129.33, 145.22, 168.86, 191.67, 179.54, 230.29, 253.21, 210.08, 222.59, 221.34, 233.54, 249.96, 220.87, 213.78, 229.21, 218.86, 210.86, 204.69, 205.9, 211.53, 254.56, 209.75, 210.1, 230.81, 214.05, 208.15, 200.81, 214.45, 214.08, 361.06, 349.63, 260.41, 253.04, 234.48, 243.91, 234.28, 267.33, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.91 s -0.00 s (0.00%)
Estimated CPU 0.46 s 0.43 s -0.03 s (-6.49%)
Peak PSS 86.12 MiB 89.32 MiB +3.20 MiB (+3.72%)
Peak RSS 88.30 MiB 91.46 MiB +3.16 MiB (+3.58%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD a3b11fc3ceec; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 43.35 s 44.97 s +1.62 s (+3.75%)
Estimated CPU 33.08 s 39.13 s +6.04 s (+18.26%)
Peak PSS 342.96 MiB 342.04 MiB -0.92 MiB (-0.27%)
Peak RSS 345.27 MiB 344.53 MiB -0.74 MiB (-0.21%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.039, 2.54, 3.54, 5.043, 6.044, 7.544, 8.545, 9.545, 11.047, 12.049, 13.55, 14.051, 14.551, 15.552, 17.053, 18.054, 19.556, 20.557, 22.058, 23.061, 24.063, 25.564, 26.565, 28.067, 29.069, 30.07, 31.572, 32.573, 34.076, 35.079, 35.58, 36.581, 37.583, 38.584, 40.086, 41.088, 42.592]
    y-axis "CPU percent" 0 --> 200
    line [33.96, 69.9, 121.75, 99.92, 123.86, 165.75, 100, 159.93, 115.99, 113.73, 107.8, 18.01, 0, 5.99, 2, 2, 71.92, 95.86, 29.95, 99.87, 59.84, 99.72, 115.79, 94.02, 117.82, 99.73, 21.97, 85.87, 21.96, 119.81, 103.77, 103.79, 35.94, 15.97, 7.99, 81.92, 25.86, 121.32]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.037, 1.037, 2.039, 2.54, 3.54, 5.043, 6.044, 7.544, 8.545, 9.545, 11.047, 12.049, 13.55, 14.051, 14.551, 15.552, 17.053, 18.054, 19.556, 20.557, 22.058, 23.061, 24.063, 25.564, 26.565, 28.067, 29.069, 30.07, 31.572, 32.573, 34.076, 35.079, 35.58, 36.581, 37.583, 38.584, 40.086, 41.088, 42.592, 43.35]
    y-axis "Memory MiB" 0 --> 500
    line [22.66, 118.59, 143.48, 165.42, 187.91, 221.93, 227.53, 232.12, 237.21, 221.16, 197.57, 217.99, 190.87, 190.71, 189.48, 191.36, 189.82, 188.47, 201.52, 188.73, 228, 190.02, 204.06, 270.18, 209.9, 237.17, 234.31, 215.54, 207.75, 220.8, 274.3, 334.52, 345.27, 199.5, 211.21, 194.92, 211.41, 197, 240.56, 0]
    line [20.75, 116.36, 141.25, 163.19, 185.67, 219.69, 225.22, 231.35, 234.9, 218.85, 195.26, 215.74, 188.55, 188.4, 187.17, 189.05, 187.5, 186.16, 199.2, 186.17, 225.69, 187.7, 201.75, 267.95, 207.59, 234.85, 232.17, 213.22, 205.43, 218.48, 271.99, 332.21, 342.96, 197.18, 208.9, 192.81, 208.85, 194.54, 238.11, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.043, 1.544, 2.547, 4.049, 5.051, 6.051, 6.555, 7.557, 9.059, 10.06, 11.562, 12.563, 14.064, 15.066, 16.569, 17.571, 18.572, 19.073, 20.075, 21.576, 22.579, 24.081, 25.082, 26.583, 27.584, 29.087, 30.088, 31.592, 32.591, 34.095, 35.096, 36.599, 37.599, 39.101, 40.102, 41.603, 42.604, 44.106]
    y-axis "CPU percent" 0 --> 500
    line [35.96, 95.87, 129.22, 133.94, 163.87, 241.77, 127.03, 113.79, 149.7, 133.98, 86.01, 101.9, 105.84, 117.88, 93.49, 2, 0, 2, 75.95, 29.97, 19.98, 47.97, 51.94, 115.87, 113.72, 77.91, 101.96, 129.77, 46.04, 51.75, 39.89, 117.77, 100.04, 81.96, 2, 61.92, 113.83, 113.88]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.042, 1.043, 1.544, 2.547, 4.049, 5.051, 6.051, 6.555, 7.557, 9.059, 10.06, 11.562, 12.563, 14.064, 15.066, 16.569, 17.571, 18.572, 19.073, 20.075, 21.576, 22.579, 24.081, 25.082, 26.583, 27.584, 29.087, 30.088, 31.592, 32.591, 34.095, 35.096, 36.599, 37.599, 39.101, 40.102, 41.603, 42.604, 44.106, 44.974]
    y-axis "Memory MiB" 0 --> 500
    line [22.71, 119.37, 138.59, 170.63, 196.1, 233.31, 301.46, 335.54, 340.29, 303.59, 291.88, 285.34, 213.98, 234.8, 228.97, 203.2, 192.85, 189.18, 189.02, 202.14, 189.99, 187.05, 187.94, 233.62, 212.78, 249.78, 209.71, 224.14, 229.86, 209.79, 199.66, 211.91, 331.84, 344.53, 248.48, 210.01, 223.73, 210.62, 233.11, 0]
    line [20.5, 116.89, 136.1, 168.14, 193.55, 230.77, 298.94, 333.02, 337.75, 301.04, 289.31, 282.77, 211.41, 232.2, 226.39, 200.64, 190.27, 186.61, 186.45, 199.54, 187.42, 184.47, 186.07, 231.06, 211.12, 247.26, 207.13, 221.58, 226.75, 207.26, 197.07, 209.3, 330.81, 342.04, 245.99, 207.47, 221.25, 208.15, 230.64, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.94 s +0.02 s (+0.08%)
Estimated CPU 0.44 s 0.45 s +0.01 s (+2.26%)
Peak PSS 88.44 MiB 86.91 MiB -1.52 MiB (-1.72%)
Peak RSS 90.65 MiB 89.32 MiB -1.33 MiB (-1.47%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD 34e0b7194521; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 42.41 s 45.85 s +3.45 s (+8.13%)
Estimated CPU 33.65 s 35.27 s +1.61 s (+4.79%)
Peak PSS 289.64 MiB 356.56 MiB +66.91 MiB (+23.10%)
Peak RSS 291.96 MiB 358.95 MiB +66.98 MiB (+22.94%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 32 / 40 +5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.039, 2.541, 3.544, 4.546, 5.546, 6.047, 7.048, 8.55, 9.552, 10.552, 12.054, 13.056, 14.057, 15.56, 16.56, 17.561, 19.062, 20.063, 20.564, 21.565, 22.566, 23.567, 25.068, 26.068, 27.068, 28.571, 29.574, 30.575, 32.076, 33.076, 34.078, 34.578, 35.578, 36.581, 38.084, 39.085, 40.086, 41.587]
    y-axis "CPU percent" 0 --> 200
    line [59.83, 119.78, 97.71, 127.73, 149.92, 129.85, 101.88, 69.9, 85.88, 95.97, 73.98, 105.72, 6, 39.9, 118.09, 89.9, 47.95, 3.99, 0, 93.94, 59.91, 101.86, 121.87, 128.04, 131.9, 121.78, 117.69, 31.95, 90.04, 9.99, 103.88, 121.96, 97.95, 3.99, 59.86, 89.96, 25.96, 127.8]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.037, 1.039, 2.541, 3.544, 4.546, 5.546, 6.047, 7.048, 8.55, 9.552, 10.552, 12.054, 13.056, 14.057, 15.56, 16.56, 17.561, 19.062, 20.063, 20.564, 21.565, 22.566, 23.567, 25.068, 26.068, 27.068, 28.571, 29.574, 30.575, 32.076, 33.076, 34.078, 34.578, 35.578, 36.581, 38.084, 39.085, 40.086, 41.587, 42.405]
    y-axis "Memory MiB" 0 --> 500
    line [23.02, 120.74, 171.13, 195.74, 220.34, 239.34, 222.07, 211.62, 234.48, 228.8, 257.77, 257.14, 196.3, 190.27, 200.18, 205.16, 189.61, 188.29, 183.55, 182.89, 215.15, 193.75, 210.84, 236.66, 248.23, 237.43, 235.88, 233.57, 220.37, 205.43, 209.74, 248.42, 291.96, 263.72, 238.85, 255.73, 246.66, 211.87, 243.73, 0]
    line [20.99, 118.39, 168.79, 193.39, 217.99, 236.94, 219.64, 209.24, 232.08, 225.87, 255.37, 254.73, 193.33, 187.87, 197.78, 202.75, 187.21, 185.94, 181.15, 180.49, 212.79, 191.35, 207.59, 234.26, 245.96, 235.03, 233.13, 231.17, 217.96, 203.02, 207.34, 246.28, 289.64, 261.32, 236.44, 253.44, 244.26, 209.44, 240, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.058, 1.558, 2.561, 3.564, 4.065, 4.566, 5.066, 6.568, 7.57, 9.072, 10.073, 11.577, 13.078, 14.079, 15.58, 16.582, 18.084, 19.085, 20.587, 21.587, 23.09, 24.592, 25.594, 27.095, 28.095, 29.598, 30.599, 32.1, 33.101, 34.602, 36.104, 37.106, 38.607, 39.608, 41.11, 42.112, 43.613, 44.614]
    y-axis "CPU percent" 0 --> 200
    line [23.93, 103.84, 115.61, 105.8, 91.87, 105.81, 161.86, 139.92, 73.84, 153.78, 30, 43.96, 101.86, 113.85, 0, 49.94, 43.94, 67.91, 3.99, 6, 19.96, 41.95, 79.89, 73.93, 131.9, 131.8, 58.04, 135.98, 65.9, 85.93, 23.97, 121.82, 103.95, 45.91, 3.99, 53.91, 57.88, 110.06]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.057, 1.058, 1.558, 2.561, 3.564, 4.065, 4.566, 5.066, 6.568, 7.57, 9.072, 10.073, 11.577, 13.078, 14.079, 15.58, 16.582, 18.084, 19.085, 20.587, 21.587, 23.09, 24.592, 25.594, 27.095, 28.095, 29.598, 30.599, 32.1, 33.101, 34.602, 36.104, 37.106, 38.607, 39.608, 41.11, 42.112, 43.613, 44.614, 45.852]
    y-axis "Memory MiB" 0 --> 500
    line [22.89, 109.11, 136.17, 149.89, 197.04, 189.3, 211.62, 241.49, 216.64, 216.92, 266.96, 226.2, 199.98, 231.13, 231.01, 201.96, 215.09, 205.85, 209.88, 198.11, 194.22, 194.99, 198.2, 197.23, 231.04, 245.21, 230.78, 208.48, 253.05, 198.02, 200.2, 198.98, 266.67, 358.95, 235.25, 207.4, 211.47, 201.37, 229.01, 0]
    line [20.98, 106.89, 133.95, 147.67, 194.67, 187.08, 209.39, 239.26, 214.4, 214.67, 264.71, 223.98, 197.65, 228.89, 228.75, 199.72, 212.86, 203.6, 207.62, 195.66, 191.72, 192.5, 195.71, 194.78, 222.65, 242.62, 227.5, 206.03, 250.6, 195.53, 197.75, 196.56, 263.37, 356.56, 232.86, 205.01, 209.08, 198.98, 226.62, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.10 s 19.97 s -0.12 s (-0.62%)
Estimated CPU 0.45 s 0.45 s 0.00 s (0.00%)
Peak PSS 86.29 MiB 86.70 MiB +0.41 MiB (+0.47%)
Peak RSS 88.43 MiB 88.77 MiB +0.34 MiB (+0.38%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD 7c2293b40343; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 38.26 s 53.53 s +15.27 s (+39.91%)
Estimated CPU 32.36 s 31.64 s -0.72 s (-2.22%)
Peak PSS 284.90 MiB 268.44 MiB -16.46 MiB (-5.78%)
Peak RSS 287.21 MiB 270.66 MiB -16.55 MiB (-5.76%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.037, 4.039, 4.539, 5.04, 5.54, 6.542, 7.542, 8.543, 9.545, 10.546, 12.047, 13.048, 14.05, 15.052, 16.054, 17.054, 18.056, 19.558, 20.559, 21.558, 22.56, 23.562, 24.563, 25.564, 26.565, 28.068, 29.069, 30.071, 31.072, 31.573, 32.074, 33.074, 34.075, 35.578, 36.579, 37.58]
    y-axis "CPU percent" 0 --> 200
    line [29.97, 107.9, 70.01, 147.71, 107.9, 91.95, 159.82, 135.78, 156.06, 44, 73.89, 103.97, 99.86, 83.97, 107.78, 99.8, 51.89, 4, 0, 19.99, 132, 172.09, 135.68, 135.69, 99.99, 117.86, 109.95, 89.89, 61.97, 27.96, 87.91, 115.8, 101.85, 93.93, 35.94, 141.83, 49.94, 115.87]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.037, 3.037, 4.039, 4.539, 5.04, 5.54, 6.542, 7.542, 8.543, 9.545, 10.546, 12.047, 13.048, 14.05, 15.052, 16.054, 17.054, 18.056, 19.558, 20.559, 21.558, 22.56, 23.562, 24.563, 25.564, 26.565, 28.068, 29.069, 30.071, 31.072, 31.573, 32.074, 33.074, 34.075, 35.578, 36.579, 37.58, 38.258]
    y-axis "Memory MiB" 0 --> 500
    line [23.07, 119.63, 160.36, 192.38, 210.74, 222.27, 243.04, 228.13, 225.13, 248.69, 209.49, 200.94, 244.06, 224.32, 200.35, 211.1, 199.63, 184.84, 181, 176.05, 189.71, 226.82, 226.21, 240.36, 243.3, 212.92, 219.48, 218.43, 221.18, 197.1, 210.39, 239.14, 287.21, 257.45, 260.6, 238.07, 240.73, 201.39, 246.36, 0]
    line [21.1, 117.37, 158.1, 190.12, 208.49, 220.01, 240.79, 225.82, 222.83, 246.39, 207.19, 198.64, 241.76, 221.48, 198.03, 208.77, 197.32, 182.51, 178.67, 173.73, 185.47, 224.55, 223.88, 238.03, 236.57, 210.59, 217.15, 216.11, 218.86, 194.77, 208.06, 236.82, 284.9, 255.13, 258.27, 235.94, 238.41, 199.07, 243.59, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.536, 2.538, 3.038, 4.039, 4.54, 6.043, 7.545, 9.046, 10.549, 12.052, 13.554, 15.055, 16.557, 18.06, 19.561, 20.062, 21.063, 22.566, 24.066, 25.567, 27.069, 28.07, 29.572, 31.073, 32.576, 34.079, 35.582, 37.082, 38.585, 40.086, 41.587, 43.089, 44.591, 46.094, 47.596, 49.098, 50.601, 52.104]
    y-axis "CPU percent" 0 --> 200
    line [0, 0, 2, 2, 0, 1.99, 0, 2, 0, 2, 85.9, 15.99, 123.88, 137.78, 85.94, 167.71, 101.8, 97.81, 116.02, 115.83, 2, 75.95, 111.88, 45.97, 63.87, 97.91, 137.74, 132.02, 127.83, 73.98, 85.88, 9.99, 117.97, 5.99, 27.95, 2, 101.79, 97.86]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.536, 2.538, 3.038, 4.039, 4.54, 6.043, 7.545, 9.046, 10.549, 12.052, 13.554, 15.055, 16.557, 18.06, 19.561, 20.062, 21.063, 22.566, 24.066, 25.567, 27.069, 28.07, 29.572, 31.073, 32.576, 34.079, 35.582, 37.082, 38.585, 40.086, 41.587, 43.089, 44.591, 46.094, 47.596, 49.098, 50.601, 52.104, 53.526]
    y-axis "Memory MiB" 0 --> 500
    line [22.91, 104.67, 102.73, 101.36, 100.98, 100.88, 100.84, 100.85, 100.85, 100.75, 100.75, 145.07, 175.95, 206.7, 222.77, 244.45, 238.86, 223.41, 198.88, 236.13, 185.43, 175.21, 185.87, 196.01, 182.98, 223.39, 199.15, 234.59, 220.67, 216.14, 208.95, 206.68, 208.37, 270.66, 207.95, 215.2, 196.79, 217.21, 208.76, 0]
    line [21.31, 102.81, 100.88, 99.48, 98.75, 98.66, 98.62, 98.63, 98.63, 98.52, 98.52, 142.84, 173.72, 204.35, 220.53, 242.21, 236.1, 221.17, 196.64, 233.89, 183.19, 172.97, 183.63, 193.77, 180.74, 221.54, 196.91, 232.35, 218.43, 213.9, 206.08, 204.44, 206.32, 268.44, 205.71, 213.54, 194.55, 214.98, 206.52, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.02 s 19.97 s -0.05 s (-0.24%)
Estimated CPU 0.47 s 0.45 s -0.02 s (-4.03%)
Peak PSS 88.00 MiB 87.82 MiB -0.19 MiB (-0.21%)
Peak RSS 90.02 MiB 89.83 MiB -0.19 MiB (-0.21%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD 863ca17efc9d; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.63 s 40.60 s -0.03 s (-0.06%)
Estimated CPU 32.29 s 30.72 s -1.57 s (-4.87%)
Peak PSS 271.99 MiB 294.60 MiB +22.61 MiB (+8.31%)
Peak RSS 274.50 MiB 296.86 MiB +22.36 MiB (+8.15%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.538, 3.541, 4.543, 5.044, 5.546, 7.048, 8.05, 9.05, 10.555, 11.556, 12.556, 13.558, 14.058, 15.06, 16.062, 17.063, 18.064, 19.566, 20.567, 21.568, 23.07, 23.57, 24.072, 25.074, 26.08, 27.582, 28.584, 29.586, 31.088, 32.09, 33.092, 34.092, 35.596, 36.598, 37.598, 38.599, 40.101]
    y-axis "CPU percent" 0 --> 200
    line [65.89, 115.97, 103.76, 123.86, 159.67, 115.66, 119.79, 123.9, 35.96, 51.89, 41.94, 137.96, 47.97, 2, 23.96, 115.91, 101.92, 47.92, 107.92, 87.95, 115.75, 131.83, 117.8, 125.69, 67.8, 127.12, 87.89, 79.72, 73.95, 23.96, 85.91, 69.91, 79.97, 23.88, 2, 91.96, 19.98, 128.04]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.538, 3.541, 4.543, 5.044, 5.546, 7.048, 8.05, 9.05, 10.555, 11.556, 12.556, 13.558, 14.058, 15.06, 16.062, 17.063, 18.064, 19.566, 20.567, 21.568, 23.07, 23.57, 24.072, 25.074, 26.08, 27.582, 28.584, 29.586, 31.088, 32.09, 33.092, 34.092, 35.596, 36.598, 37.598, 38.599, 40.101, 40.626]
    y-axis "Memory MiB" 0 --> 500
    line [22.75, 118.76, 169.57, 201.99, 213.53, 237.87, 226.05, 220, 234.66, 202.52, 198.89, 206.76, 207.18, 191.57, 191.57, 188.83, 205.81, 198.14, 185.29, 228.09, 200.83, 205.04, 247.23, 274.5, 223.37, 205.77, 224.43, 206.66, 205.46, 197.95, 195.77, 217.55, 192.23, 198.71, 197.86, 171.3, 195.61, 192.7, 236.96, 0]
    line [20.33, 116.1, 166.93, 199.35, 210.88, 237.21, 223.38, 217.31, 231.96, 199.84, 197.26, 204.08, 204.21, 188.88, 188.88, 185.92, 204.54, 193.43, 182.59, 225.4, 198.13, 202.34, 244.55, 271.99, 220.69, 203.07, 221.88, 203.97, 202.85, 195.25, 193.06, 215.28, 189.58, 195.83, 195.2, 168.78, 193.21, 190.37, 234.69, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.039, 2.54, 3.04, 3.54, 4.542, 5.542, 7.043, 8.046, 9.047, 10.549, 11.551, 12.552, 13.554, 15.057, 16.059, 17.06, 18.061, 19.563, 20.563, 21.565, 23.068, 24.07, 25.071, 26.071, 27.573, 28.573, 29.575, 31.077, 32.078, 33.079, 33.58, 34.081, 35.583, 36.584, 37.585, 38.586, 40.089]
    y-axis "CPU percent" 0 --> 200
    line [25.93, 109.7, 137.83, 87.86, 103.99, 175.61, 0, 97.93, 123.84, 95.87, 79.94, 103.88, 97.85, 103.79, 49.91, 89.82, 63.89, 59.92, 25.99, 92.02, 85.88, 129.73, 89.88, 107.9, 114.06, 83.89, 44, 3.99, 39.98, 4, 87.96, 119.79, 89.81, 3.99, 2, 63.94, 47.96, 131.86]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.039, 2.54, 3.04, 3.54, 4.542, 5.542, 7.043, 8.046, 9.047, 10.549, 11.551, 12.552, 13.554, 15.057, 16.059, 17.06, 18.061, 19.563, 20.563, 21.565, 23.068, 24.07, 25.071, 26.071, 27.573, 28.573, 29.575, 31.077, 32.078, 33.079, 33.58, 34.081, 35.583, 36.584, 37.585, 38.586, 40.089, 40.6]
    y-axis "Memory MiB" 0 --> 500
    line [23.05, 118.84, 148.24, 174.33, 179.72, 187.44, 224.6, 208.56, 238.64, 235.36, 246.28, 233.49, 215.72, 243.2, 259.6, 251.49, 263.59, 237.55, 231.8, 228.28, 241.86, 277.23, 276.52, 213.24, 193.04, 204.05, 206.4, 194.65, 190.23, 196.36, 186.76, 237.09, 296.86, 235.79, 231.01, 242.66, 215.45, 199.03, 247.73, 0]
    line [21.06, 115.47, 145.98, 172.07, 177.46, 185.47, 222.65, 206.6, 236.69, 233.4, 244.37, 231.54, 213.95, 241.34, 256.36, 249.14, 261.7, 235.69, 229.54, 225.89, 239.59, 274.96, 274.25, 209.19, 190.77, 201.78, 204.12, 192.37, 187.95, 194.01, 184.48, 235.39, 294.6, 233.51, 228.73, 240.38, 213.18, 196.75, 245.29, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.10 s 20.01 s -0.09 s (-0.44%)
Estimated CPU 0.45 s 0.47 s +0.02 s (+3.97%)
Peak PSS 83.95 MiB 87.08 MiB +3.13 MiB (+3.73%)
Peak RSS 86.52 MiB 89.64 MiB +3.12 MiB (+3.61%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD 5b0edf53128e; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.53 s 42.88 s +2.35 s (+5.80%)
Estimated CPU 31.80 s 33.98 s +2.18 s (+6.85%)
Peak PSS 276.04 MiB 341.93 MiB +65.89 MiB (+23.87%)
Peak RSS 278.67 MiB 344.91 MiB +66.25 MiB (+23.77%)
Peak threads 27 26 -1 (-3.70%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.05, 2.051, 2.552, 3.552, 4.556, 5.557, 7.059, 8.06, 9.06, 10.064, 11.567, 12.067, 12.567, 13.572, 14.576, 16.078, 17.079, 18.079, 19.081, 20.584, 21.585, 22.586, 23.586, 25.086, 26.086, 27.088, 28.092, 29.594, 30.595, 31.597, 32.599, 34.1, 35.101, 36.105, 36.605, 37.106, 38.612, 39.614]
    y-axis "CPU percent" 0 --> 200
    line [44.01, 95.87, 123.83, 57.97, 101.75, 93.84, 125.93, 151.86, 87.89, 71.56, 69.88, 105.94, 109.97, 35.72, 51.75, 79.92, 65.96, 109.93, 71.92, 65.93, 117.79, 119.93, 91.98, 99.88, 97.96, 3.99, 111.11, 73.93, 41.96, 25.93, 85.88, 89.81, 14, 51.94, 0, 59.93, 33.77, 111.89]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.05, 1.05, 2.051, 2.552, 3.552, 4.556, 5.557, 7.059, 8.06, 9.06, 10.064, 11.567, 12.067, 12.567, 13.572, 14.576, 16.078, 17.079, 18.079, 19.081, 20.584, 21.585, 22.586, 23.586, 25.086, 26.086, 27.088, 28.092, 29.594, 30.595, 31.597, 32.599, 34.1, 35.101, 36.105, 36.605, 37.106, 38.612, 39.614, 40.53]
    y-axis "Memory MiB" 0 --> 500
    line [22.79, 121.15, 148.39, 175.49, 186.64, 181.91, 237.31, 209.07, 236.59, 216.39, 214.17, 260.75, 278.67, 204.58, 193.81, 194.48, 188.51, 181.78, 220.88, 204.27, 201.38, 232.21, 243.1, 234.77, 217.02, 220.81, 212.87, 222.9, 181.19, 186.83, 202.08, 229.52, 226.81, 192.95, 203.8, 203.84, 207.36, 194.86, 224.15, 0]
    line [20.53, 118.59, 145.77, 172.86, 184.1, 179.28, 234.68, 206.43, 233.96, 213.75, 211.54, 258.12, 276.04, 200.81, 191.12, 191.77, 185.82, 179.09, 218.19, 201.57, 198.68, 229.52, 240.54, 232.07, 214.33, 218.11, 210.17, 219.42, 177.99, 184.14, 199.38, 227.24, 224.12, 190.25, 201.11, 201.15, 204.64, 192.17, 221.46, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.038, 2.539, 3.542, 5.048, 5.549, 6.05, 7.555, 8.555, 10.056, 11.059, 12.564, 13.564, 14.564, 16.067, 17.067, 18.569, 19.571, 21.075, 22.076, 23.577, 24.577, 26.079, 27.08, 28.581, 29.582, 30.584, 32.086, 33.088, 34.089, 34.589, 35.09, 35.59, 37.091, 38.092, 39.093, 39.594, 40.595, 42.096]
    y-axis "CPU percent" 0 --> 200
    line [6, 92.01, 91.91, 81.95, 163.5, 43.94, 133.09, 62.02, 62.03, 31.97, 63.85, 130.02, 50.01, 71.85, 100.06, 17.98, 51.9, 55.94, 111.9, 120.06, 112, 53.93, 123.93, 100.01, 69.9, 87.75, 21.96, 97.73, 111.89, 97.97, 103.8, 87.95, 9.99, 15.95, 0, 113.81, 31.98, 107.87]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.038, 1.038, 2.539, 3.542, 5.048, 5.549, 6.05, 7.555, 8.555, 10.056, 11.059, 12.564, 13.564, 14.564, 16.067, 17.067, 18.569, 19.571, 21.075, 22.076, 23.577, 24.577, 26.079, 27.08, 28.581, 29.582, 30.584, 32.086, 33.088, 34.089, 34.589, 35.09, 35.59, 37.091, 38.092, 39.093, 39.594, 40.595, 42.096, 42.88]
    y-axis "Memory MiB" 0 --> 500
    line [22.83, 88.34, 168.37, 176.04, 202.54, 228.78, 240.17, 230.01, 207.05, 214.85, 200.03, 210.49, 244.15, 210.1, 211.85, 218.75, 199.45, 194.06, 198.37, 197.51, 249.69, 273.27, 208.66, 227.3, 224.37, 213.03, 211.4, 209.45, 276.64, 344.57, 336.3, 344.91, 224.11, 200.16, 202.97, 203.32, 214.2, 198.41, 240.72, 0]
    line [20.61, 85.8, 165.83, 173.5, 200, 225.69, 237.61, 227.41, 204.68, 212.36, 197.46, 207.89, 241.53, 207.48, 209.23, 216.1, 196.8, 191.48, 195.93, 194.87, 247.06, 270.64, 206.02, 224.67, 221.75, 210.42, 208.76, 206.81, 273.44, 341.93, 333.66, 341.79, 221.47, 197.52, 200.36, 200.89, 211.57, 195.77, 238.08, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.31 s 20.10 s -0.21 s (-1.05%)
Estimated CPU 0.49 s 0.43 s -0.06 s (-12.35%)
Peak PSS 83.67 MiB 81.42 MiB -2.25 MiB (-2.69%)
Peak RSS 85.72 MiB 83.41 MiB -2.31 MiB (-2.69%)
Peak threads 19 18 -1 (-5.26%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 1e5fdc5c84d8 → HEAD cdc94a0cf450; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 41.58 s 39.62 s -1.95 s (-4.70%)
Estimated CPU 32.66 s 33.75 s +1.09 s (+3.33%)
Peak PSS 263.17 MiB 348.56 MiB +85.39 MiB (+32.45%)
Peak RSS 265.98 MiB 351.32 MiB +85.34 MiB (+32.08%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.056, 2.057, 2.557, 3.56, 4.561, 5.062, 6.064, 7.066, 8.067, 9.068, 10.57, 11.571, 12.572, 14.075, 14.576, 15.077, 16.078, 17.579, 18.579, 19.58, 21.082, 22.083, 23.083, 24.084, 25.585, 26.587, 27.588, 29.089, 30.09, 31.095, 32.597, 33.597, 34.599, 35.6, 37.104, 38.106, 39.108, 40.611]
    y-axis "CPU percent" 0 --> 200
    line [5.99, 83.9, 97.9, 83.81, 83.92, 159.85, 3.99, 147.58, 117.84, 155.83, 45.96, 107.85, 103.81, 17.98, 0, 5.98, 97.91, 7.99, 48.06, 17.98, 29.96, 103.93, 111.97, 138.04, 115.92, 43.92, 125.89, 72.02, 71.91, 91.26, 26, 112.06, 61.92, 27.96, 55.87, 39.88, 65.83, 110.11]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.056, 1.056, 2.057, 2.557, 3.56, 4.561, 5.062, 6.064, 7.066, 8.067, 9.068, 10.57, 11.571, 12.572, 14.075, 14.576, 15.077, 16.078, 17.579, 18.579, 19.58, 21.082, 22.083, 23.083, 24.084, 25.585, 26.587, 27.588, 29.089, 30.09, 31.095, 32.597, 33.597, 34.599, 35.6, 37.104, 38.106, 39.108, 40.611, 41.575]
    y-axis "Memory MiB" 0 --> 500
    line [22.88, 86.29, 134.93, 151.73, 190.64, 201.67, 231.1, 214.28, 224.6, 210.12, 240.35, 214.53, 230.3, 229.29, 200.18, 200.21, 199.3, 222.54, 196.65, 193.97, 193.2, 180.31, 198.63, 214.68, 235.66, 224.29, 207.23, 231.25, 203.12, 206.77, 199.11, 204.72, 265.98, 216.34, 211.82, 195.64, 203.25, 201.93, 238.04, 0]
    line [20.57, 83.54, 132.18, 148.99, 187.99, 200.92, 228.36, 211.54, 219.08, 207.38, 237.33, 211.78, 227.56, 226.69, 197.39, 197.89, 196.98, 220.31, 193.84, 191.15, 190.38, 177.47, 195.81, 211.86, 232.88, 221.81, 204.41, 228.42, 200.31, 204.09, 196.29, 202.85, 263.17, 213.53, 209.01, 192.82, 200.53, 199.13, 235.21, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.044, 2.047, 3.052, 3.552, 4.553, 5.053, 5.554, 6.557, 8.062, 9.063, 10.065, 11.067, 12.069, 13.569, 14.57, 15.571, 16.575, 18.08, 19.081, 20.081, 21.083, 22.084, 23.585, 24.587, 25.591, 26.593, 28.094, 29.095, 30.097, 31.097, 32.098, 33.603, 34.605, 35.606, 36.106, 36.607, 38.109, 39.111]
    y-axis "CPU percent" 0 --> 200
    line [61.87, 53.79, 125.66, 101.96, 127.75, 151.93, 105.96, 117.57, 129.76, 59.93, 65.89, 63.87, 123.82, 24.01, 115.88, 101.86, 51.74, 79.83, 71.9, 74, 113.88, 117.83, 103.97, 121.78, 125.2, 61.87, 66.01, 9.98, 72, 103.88, 95.86, 67.43, 11.97, 49.96, 0, 101.91, 103.93, 123.86]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.043, 1.044, 2.047, 3.052, 3.552, 4.553, 5.053, 5.554, 6.557, 8.062, 9.063, 10.065, 11.067, 12.069, 13.569, 14.57, 15.571, 16.575, 18.08, 19.081, 20.081, 21.083, 22.084, 23.585, 24.587, 25.591, 26.593, 28.094, 29.095, 30.097, 31.097, 32.098, 33.603, 34.605, 35.606, 36.106, 36.607, 38.109, 39.111, 39.623]
    y-axis "Memory MiB" 0 --> 500
    line [23.03, 123.07, 144.88, 179.53, 194.23, 214.72, 237.27, 256.71, 233.62, 242.96, 222.77, 219.64, 247.87, 280.73, 203.06, 208.13, 192.6, 178.7, 218.76, 197.04, 210.86, 241.38, 259.09, 214.22, 202.14, 247.97, 205.54, 201.34, 199.61, 228.94, 325.61, 351.32, 244.12, 206.65, 222.44, 222.52, 221.41, 207.69, 256.88, 0]
    line [20.67, 120.34, 144.17, 176.81, 195.5, 212, 234.54, 254.33, 230.89, 240.23, 220.04, 216.9, 245.13, 277.98, 200.32, 205.37, 189.84, 175.91, 216, 194.3, 208.11, 238.63, 256.36, 211.17, 198.31, 245.21, 202.76, 198.56, 196.86, 226.24, 322.9, 348.56, 241.37, 203.9, 219.68, 219.76, 218.74, 204.94, 254.12, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.10 s 20.04 s -0.06 s (-0.30%)
Estimated CPU 0.47 s 0.46 s -0.01 s (-2.33%)
Peak PSS 82.21 MiB 87.18 MiB +4.96 MiB (+6.04%)
Peak RSS 84.23 MiB 89.84 MiB +5.61 MiB (+6.66%)
Peak threads 19 18 -1 (-5.26%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from cdc94a0 to 1fe9b30 Compare August 18, 2026 12:01
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD 1fe9b30c33ac; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 43.66 s 40.77 s -2.89 s (-6.62%)
Estimated CPU 31.16 s 29.89 s -1.27 s (-4.09%)
Peak PSS 275.43 MiB 255.50 MiB -19.93 MiB (-7.24%)
Peak RSS 277.52 MiB 257.62 MiB -19.90 MiB (-7.17%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.539, 3.541, 4.542, 5.043, 6.044, 7.546, 8.546, 10.047, 11.047, 12.047, 13.048, 13.549, 14.549, 16.051, 17.051, 18.552, 19.553, 21.055, 22.056, 23.057, 24.558, 25.56, 26.061, 27.062, 28.064, 29.565, 30.566, 32.069, 33.07, 34.072, 35.573, 36.574, 38.076, 39.077, 40.579, 41.581, 43.084]
    y-axis "CPU percent" 0 --> 200
    line [49.93, 123.8, 97.89, 71.88, 107.86, 135.84, 169.77, 117.98, 95.88, 83.95, 82.02, 2, 7.99, 103.96, 21.98, 25.99, 121.91, 65.95, 137.87, 135.81, 121.81, 28.01, 121.73, 125.74, 71.92, 3.99, 47.95, 81.93, 7.99, 59.9, 79.81, 2, 37.97, 9.99, 45.95, 59.93, 49.92, 129.79]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.539, 3.541, 4.542, 5.043, 6.044, 7.546, 8.546, 10.047, 11.047, 12.047, 13.048, 13.549, 14.549, 16.051, 17.051, 18.552, 19.553, 21.055, 22.056, 23.057, 24.558, 25.56, 26.061, 27.062, 28.064, 29.565, 30.566, 32.069, 33.07, 34.072, 35.573, 36.574, 38.076, 39.077, 40.579, 41.581, 43.084, 43.659]
    y-axis "Memory MiB" 0 --> 500
    line [23.23, 120.92, 178.65, 195.09, 226.64, 251.61, 230.91, 241.8, 240.01, 236.67, 231.69, 222.45, 191.72, 183.58, 210.16, 191.01, 188.02, 233.01, 202.53, 214.66, 246, 231.18, 193.47, 212.9, 277.52, 240.72, 224.82, 201.97, 200.57, 196.13, 212.98, 213.64, 203.51, 206.92, 196.3, 214.96, 208.29, 199.43, 245.24, 0]
    line [21.42, 118.88, 176.6, 193.54, 224.56, 249.54, 228.66, 240.45, 238.31, 234.57, 229.6, 220.44, 189.62, 181.48, 207.71, 188.91, 185.92, 230.91, 200.43, 212.56, 243.63, 229.09, 191.38, 210.8, 275.43, 238.67, 222.72, 199.88, 198.47, 194.04, 210.9, 211.54, 201.41, 204.82, 194.21, 212.89, 206.2, 197.33, 242.71, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 2.539, 3.541, 4.543, 5.544, 7.045, 8.046, 9.048, 10.548, 11.55, 12.551, 13.552, 15.053, 16.054, 16.554, 17.055, 18.056, 19.558, 20.56, 21.564, 23.067, 24.069, 25.069, 26.071, 27.573, 28.575, 29.076, 29.577, 31.079, 32.081, 33.082, 34.083, 35.586, 36.587, 37.588, 38.59, 40.092]
    y-axis "CPU percent" 0 --> 200
    line [57.92, 63.9, 117.78, 93.9, 147.78, 141.83, 149.81, 51.93, 59.91, 128.01, 77.85, 25.97, 99.92, 29.97, 9.99, 0, 6, 25.98, 85.79, 19.95, 45.89, 39.94, 105.92, 119.84, 117.83, 37.95, 119.82, 139.82, 115.82, 77.91, 11.98, 3.99, 121.91, 17.97, 55.94, 43.96, 45.93, 115.81]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.036, 2.038, 2.539, 3.541, 4.543, 5.544, 7.045, 8.046, 9.048, 10.548, 11.55, 12.551, 13.552, 15.053, 16.054, 16.554, 17.055, 18.056, 19.558, 20.56, 21.564, 23.067, 24.069, 25.069, 26.071, 27.573, 28.575, 29.076, 29.577, 31.079, 32.081, 33.082, 34.083, 35.586, 36.587, 37.588, 38.59, 40.092, 40.768]
    y-axis "Memory MiB" 0 --> 500
    line [23.16, 120.72, 142.37, 160.96, 185.88, 219.29, 224.05, 248.18, 238.73, 220.49, 230.11, 217.81, 180.09, 200.13, 190.2, 188.64, 188.64, 188.6, 188.82, 182.16, 173.83, 180.38, 178.43, 207.99, 241.93, 254.85, 204.56, 255.72, 257.62, 234.9, 206.42, 198.71, 205.25, 235.95, 199.7, 199.81, 198.45, 190.73, 239.38, 0]
    line [21.41, 118.69, 140.35, 159, 183.85, 217.27, 221.46, 246.07, 236.11, 218.43, 228.05, 215.72, 177.63, 198.04, 188.1, 186.55, 186.55, 186.5, 186.73, 180.03, 171.7, 178.25, 176.31, 205.88, 239.88, 252.08, 202.45, 253.63, 255.5, 232.78, 200.91, 196.58, 203.12, 233.85, 197.6, 197.71, 196.36, 188.64, 237.33, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.07 s 19.92 s -0.15 s (-0.75%)
Estimated CPU 0.45 s 0.45 s -0.00 s (-0.22%)
Peak PSS 87.13 MiB 89.02 MiB +1.88 MiB (+2.16%)
Peak RSS 89.18 MiB 91.10 MiB +1.91 MiB (+2.15%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD f38dc3b37ce7; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 41.20 s 43.60 s +2.40 s (+5.82%)
Estimated CPU 30.73 s 30.75 s +0.02 s (+0.07%)
Peak PSS 357.40 MiB 280.89 MiB -76.51 MiB (-21.41%)
Peak RSS 360.08 MiB 283.08 MiB -77.00 MiB (-21.38%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.538, 3.038, 3.54, 4.542, 6.043, 7.045, 8.046, 9.047, 10.548, 11.55, 12.55, 14.054, 15.054, 16.055, 17.557, 18.558, 19.56, 21.062, 22.064, 23.065, 24.067, 25.067, 25.567, 26.567, 27.569, 29.07, 30.071, 31.073, 32.574, 33.575, 34.577, 35.577, 37.08, 38.081, 39.083, 40.585]
    y-axis "CPU percent" 0 --> 200
    line [31.97, 85.82, 119.68, 65.91, 99.8, 169.58, 141.7, 105.84, 109.89, 53.93, 104, 115.72, 83.94, 85.84, 4, 49.95, 45.93, 123.79, 61.94, 89.82, 29.97, 123.88, 2, 0, 4, 2, 115.89, 95.93, 57.94, 27.93, 125.97, 101.8, 41.97, 87.95, 53.88, 61.94, 53.92, 122.01]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.036, 2.538, 3.038, 3.54, 4.542, 6.043, 7.045, 8.046, 9.047, 10.548, 11.55, 12.55, 14.054, 15.054, 16.055, 17.557, 18.558, 19.56, 21.062, 22.064, 23.065, 24.067, 25.067, 25.567, 26.567, 27.569, 29.07, 30.071, 31.073, 32.574, 33.575, 34.577, 35.577, 37.08, 38.081, 39.083, 40.585, 41.197]
    y-axis "Memory MiB" 0 --> 500
    line [22.72, 116.18, 148.6, 175.05, 178.61, 193.94, 240.05, 213.36, 227.37, 236.54, 230.42, 215.7, 224.99, 200.95, 207.51, 195.59, 186.39, 214.36, 212.66, 219.05, 219.64, 205.68, 255.58, 220.93, 188.13, 186.27, 185.73, 196.95, 198.46, 189.52, 205.1, 287.35, 360.08, 264.05, 261.54, 197.91, 209.5, 196.64, 240.55, 0]
    line [20.89, 114.04, 146.49, 172.91, 176.47, 191.21, 237.78, 211.2, 225.61, 234.38, 228.26, 213.57, 222.83, 198.85, 205.35, 193.5, 184.24, 212.2, 210.68, 216.9, 217.5, 203.53, 253.42, 218.77, 185.97, 184.11, 183.57, 194.79, 196.3, 187.36, 203, 285.23, 357.4, 261.89, 259.38, 195.75, 207.36, 194.48, 238.61, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.034, 1.535, 2.537, 4.04, 4.541, 5.042, 6.545, 7.546, 9.049, 10.05, 11.551, 12.552, 14.054, 14.555, 15.056, 16.558, 17.558, 19.06, 20.061, 21.563, 22.564, 24.066, 25.068, 26.57, 27.571, 29.073, 30.074, 31.576, 32.576, 34.078, 35.079, 36.581, 37.581, 39.082, 40.084, 41.585, 42.587, 43.589]
    y-axis "CPU percent" 0 --> 200
    line [31.98, 93.74, 107.72, 101.79, 169.69, 97.8, 131.75, 61.93, 59.93, 59.91, 49.96, 127.91, 33.92, 0, 2, 89.93, 41.98, 12, 37.96, 59.9, 103.84, 93.85, 135.71, 113.9, 97.77, 111.79, 25.99, 94, 10, 123.77, 2, 33.94, 45.95, 2, 0, 25.96, 117.74, 61.89]
Loading
xychart-beta
    title "HEAD memory: RSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 1.535, 2.537, 4.04, 4.541, 5.042, 6.545, 7.546, 9.049, 10.05, 11.551, 12.552, 14.054, 14.555, 15.056, 16.558, 17.558, 19.06, 20.061, 21.563, 22.564, 24.066, 25.068, 26.57, 27.571, 29.073, 30.074, 31.576, 32.576, 34.078, 35.079, 36.581, 37.581, 39.082, 40.084, 41.585, 42.587, 43.589, 43.596]
    y-axis "Memory MiB" 0 --> 500
    line [22.93, 120.35, 135.74, 153.32, 200.66, 230.62, 236.69, 229.3, 245.88, 219.49, 193.93, 213, 236.91, 206.33, 206.33, 205.34, 206.19, 204.14, 195.34, 191.99, 223.3, 208.04, 250.1, 253.49, 215.72, 218.73, 236.32, 226.53, 225.29, 223.55, 283.08, 226.54, 221.96, 217.2, 196.25, 218.89, 196.66, 235.21, 0, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.93 s 19.92 s -0.00 s (-0.02%)
Estimated CPU 0.46 s 0.45 s -0.01 s (-2.16%)
Peak PSS 88.19 MiB 87.21 MiB -0.97 MiB (-1.11%)
Peak RSS 90.32 MiB 89.48 MiB -0.84 MiB (-0.93%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD 8c3d6e72dd39; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 40.33 s 37.44 s -2.89 s (-7.17%)
Estimated CPU 31.27 s 31.65 s +0.38 s (+1.21%)
Peak PSS 268.38 MiB 282.47 MiB +14.09 MiB (+5.25%)
Peak RSS 271.06 MiB 284.54 MiB +13.48 MiB (+4.97%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 32 / 40 +5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.04, 2.042, 2.543, 3.043, 3.543, 4.546, 6.048, 7.049, 7.55, 8.051, 9.554, 10.554, 11.555, 12.557, 14.063, 15.066, 16.066, 17.569, 18.569, 19.571, 21.075, 22.076, 23.078, 24.58, 25.581, 26.583, 28.085, 29.085, 30.087, 31.089, 32.591, 33.091, 33.592, 34.593, 36.095, 37.097, 38.098, 39.599]
    y-axis "CPU percent" 0 --> 200
    line [35.98, 121.96, 129.79, 103.95, 91.94, 171.57, 141.81, 65.9, 171.63, 69.87, 79.88, 84.03, 49.96, 83.74, 0, 47.9, 103.92, 3.99, 29.98, 31.95, 39.99, 85.89, 111.84, 125.7, 141.8, 97.88, 135.83, 61.94, 101.87, 7.98, 121.96, 125.83, 75.85, 42, 51.86, 69.8, 27.97, 111.9]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.041, 1.04, 2.042, 2.543, 3.043, 3.543, 4.546, 6.048, 7.049, 7.55, 8.051, 9.554, 10.554, 11.555, 12.557, 14.063, 15.066, 16.066, 17.569, 18.569, 19.571, 21.075, 22.076, 23.078, 24.58, 25.581, 26.583, 28.085, 29.085, 30.087, 31.089, 32.591, 33.091, 33.592, 34.593, 36.095, 37.097, 38.098, 39.599, 40.329]
    y-axis "Memory MiB" 0 --> 500
    line [22.96, 120.97, 164, 182.9, 193.15, 190, 231.57, 236.32, 258.54, 255.15, 249.85, 237.87, 205.48, 222.88, 207.49, 199.95, 203.88, 209.01, 187.51, 179.55, 185.75, 192.07, 201.94, 255.37, 271.06, 214.84, 211.39, 235.69, 212.31, 195.34, 195.8, 263.36, 270.71, 225.61, 218.29, 212.59, 214.18, 197.63, 240.05, 0]
    line [20.67, 118.34, 161.34, 180.17, 190.51, 187.32, 228.87, 233.52, 255.46, 256.19, 247.13, 235.14, 202.76, 220.17, 204.71, 197.24, 201.09, 206.17, 184.81, 176.83, 183.05, 189.35, 199.23, 252.66, 268.33, 211.51, 208.46, 232.96, 209.85, 192.99, 193.46, 261.03, 268.38, 223.29, 215.93, 210.56, 209.19, 195.6, 238.01, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.04, 4.042, 4.543, 5.043, 6.043, 6.544, 7.545, 8.547, 9.547, 10.547, 11.548, 12.55, 13.551, 14.553, 15.554, 16.554, 17.555, 19.061, 20.062, 21.063, 22.063, 23.063, 24.065, 25.067, 26.069, 27.07, 28.072, 29.073, 29.574, 30.074, 31.574, 32.576, 33.577, 34.578, 35.579, 36.58]
    y-axis "CPU percent" 0 --> 200
    line [49.9, 103.8, 113.83, 133.69, 155.82, 133.81, 124.05, 101.86, 143.71, 55.96, 79.99, 134.07, 77.89, 89.87, 109.85, 53.89, 4, 91.9, 33.99, 125.88, 124.1, 121.86, 94.03, 101.9, 109.86, 93.52, 79.92, 97.95, 15.99, 83.94, 125.84, 95.9, 18, 2, 0, 107.9, 39.97, 111.88]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.036, 2.038, 3.04, 4.042, 4.543, 5.043, 6.043, 6.544, 7.545, 8.547, 9.547, 10.547, 11.548, 12.55, 13.551, 14.553, 15.554, 16.554, 17.555, 19.061, 20.062, 21.063, 22.063, 23.063, 24.065, 25.067, 26.069, 27.07, 28.072, 29.073, 29.574, 30.074, 31.574, 32.576, 33.577, 34.578, 35.579, 36.58, 37.436]
    y-axis "Memory MiB" 0 --> 500
    line [22.77, 100.32, 154.18, 187.41, 197.25, 252.14, 269.65, 232.3, 226.95, 255.54, 234.36, 245.87, 244.75, 219.67, 207.19, 211.41, 193.4, 182.8, 217.55, 186.18, 218.08, 244.88, 264.97, 211.75, 207.75, 258.52, 208.77, 196.29, 194.92, 201.05, 234.66, 284.54, 250.21, 223.42, 211.4, 231.29, 226.31, 211.45, 232.77, 0]
    line [21.02, 98.25, 152.26, 185.34, 195.18, 251.31, 267.57, 230.22, 224.96, 253.46, 232.29, 243.75, 242.58, 217.49, 204.6, 209.27, 191.26, 180.66, 215.42, 184.04, 215.94, 242.92, 263.15, 209.62, 205.39, 256.15, 206.59, 194.31, 192.78, 198.93, 232.92, 282.47, 248.1, 221.37, 209.35, 229.24, 224.26, 209.4, 230.82, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.13 s 20.00 s -0.13 s (-0.66%)
Estimated CPU 0.46 s 0.44 s -0.02 s (-4.53%)
Peak PSS 84.23 MiB 87.51 MiB +3.28 MiB (+3.89%)
Peak RSS 86.91 MiB 90.06 MiB +3.16 MiB (+3.63%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 178 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD 9941a6bf63ca; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 178 / 240 -1 (-0.56%)
Contract fill 74.58% 74.17% -0.41 pp (-0.55%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 34 / 48 -1 (-2.86%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 3 +1 (+50.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 34; HTTP error + rows: 3; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 39.89 s 38.98 s -0.90 s (-2.26%)
Estimated CPU 34.22 s 29.04 s -5.17 s (-15.12%)
Peak PSS 344.26 MiB 284.66 MiB -59.60 MiB (-17.31%)
Peak RSS 346.81 MiB 287.07 MiB -59.75 MiB (-17.23%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 36 / 40 -1
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.039, 3.039, 3.539, 4.54, 5.542, 6.043, 6.543, 8.043, 9.043, 10.043, 11.045, 12.046, 13.548, 14.549, 15.551, 16.552, 18.054, 19.056, 19.558, 20.058, 21.059, 22.06, 23.562, 24.562, 25.562, 26.563, 28.065, 29.065, 30.066, 31.068, 32.069, 33.571, 34.572, 35.573, 36.575, 38.077, 39.078]
    y-axis "CPU percent" 0 --> 500
    line [57.92, 111.87, 93.95, 131.9, 167.92, 195.75, 127.88, 181.93, 137.97, 170.02, 79.99, 75.84, 127.88, 43.95, 77.82, 5.98, 60.06, 59.94, 4, 0, 31.98, 51.94, 97.91, 127.78, 123.97, 136.05, 79.89, 113.98, 43.94, 79.93, 5.99, 63.89, 61.94, 9.99, 39.95, 53.93, 57.93, 117.83]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.039, 3.039, 3.539, 4.54, 5.542, 6.043, 6.543, 8.043, 9.043, 10.043, 11.045, 12.046, 13.548, 14.549, 15.551, 16.552, 18.054, 19.056, 19.558, 20.058, 21.059, 22.06, 23.562, 24.562, 25.562, 26.563, 28.065, 29.065, 30.066, 31.068, 32.069, 33.571, 34.572, 35.573, 36.575, 38.077, 39.078, 39.888]
    y-axis "Memory MiB" 0 --> 500
    line [22.7, 124.48, 150.46, 181.98, 192.11, 273.88, 324.84, 346.81, 322.64, 306.37, 340.46, 314.83, 323.88, 289.48, 196.38, 215.68, 202.41, 194.47, 187.19, 182.58, 180.93, 184.96, 214.18, 201.26, 247.3, 262.5, 222.29, 210.92, 226.34, 209.27, 201.58, 199.21, 217.93, 235.74, 203.89, 221.13, 213.71, 205.85, 247, 0]
    line [20.65, 122.09, 148.13, 179.33, 189.74, 271.57, 322.47, 344.26, 320.33, 303.99, 337.59, 312.43, 321.48, 287.52, 193.98, 213.28, 200.01, 192.08, 184.8, 180.18, 178.53, 182.66, 211.78, 198.99, 244.78, 260.28, 219.94, 206.56, 223.94, 206.87, 199.95, 196.81, 215.53, 233.35, 201.5, 218.73, 211.38, 203.45, 244.62, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.04, 3.541, 4.041, 4.542, 5.543, 6.546, 7.548, 8.549, 10.052, 11.052, 12.053, 13.055, 14.056, 15.058, 16.56, 17.562, 18.563, 19.564, 20.565, 21.066, 21.567, 23.069, 24.071, 25.071, 26.073, 27.073, 28.076, 29.578, 30.579, 31.58, 32.581, 33.582, 34.583, 36.084, 37.085, 38.087]
    y-axis "CPU percent" 0 --> 200
    line [49.87, 117.75, 95.8, 93.75, 165.89, 135.76, 127.83, 113.79, 113.71, 51.96, 109.76, 87.99, 0, 59.87, 95.92, 35.91, 75.92, 15.97, 109.88, 111.86, 133.93, 123.74, 137.66, 97.89, 77.83, 69.93, 83.8, 17.99, 17.98, 59.91, 2, 0, 13.98, 7.99, 3.99, 101.91, 35.97, 113.85]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.038, 3.04, 3.541, 4.041, 4.542, 5.543, 6.546, 7.548, 8.549, 10.052, 11.052, 12.053, 13.055, 14.056, 15.058, 16.56, 17.562, 18.563, 19.564, 20.565, 21.066, 21.567, 23.069, 24.071, 25.071, 26.073, 27.073, 28.076, 29.578, 30.579, 31.58, 32.581, 33.582, 34.583, 36.084, 37.085, 38.087, 38.985]
    y-axis "Memory MiB" 0 --> 500
    line [22.72, 123.21, 161.22, 182.83, 206.81, 231.2, 239.89, 239.82, 250.95, 248.57, 227.14, 227.95, 226.58, 213.17, 193.53, 202.79, 191.68, 219.39, 189.22, 208.21, 241.93, 259.89, 287.07, 233.17, 219.09, 270.61, 190.66, 187.2, 187.61, 195.56, 203.5, 196.7, 192.49, 191.23, 193.06, 182.15, 203.26, 187.55, 221.89, 0]
    line [20.78, 120.91, 159.02, 180.53, 204.51, 228.5, 237.55, 237.6, 249.14, 245.07, 224.74, 225.55, 224.17, 210.77, 191.13, 200.38, 189.27, 216.99, 186.82, 205.86, 239.53, 253.93, 284.66, 230.77, 216.36, 268.2, 188.27, 184.8, 185.21, 193.15, 201.1, 194.3, 190.08, 188.82, 190.65, 179.74, 200.78, 185, 219.55, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.92 s -0.01 s (-0.03%)
Estimated CPU 0.42 s 0.46 s +0.04 s (+9.24%)
Peak PSS 88.50 MiB 87.31 MiB -1.19 MiB (-1.34%)
Peak RSS 90.84 MiB 89.59 MiB -1.25 MiB (-1.37%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD 2fa089bb28a8; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 36.53 s 38.72 s +2.19 s (+6.00%)
Estimated CPU 31.50 s 31.79 s +0.29 s (+0.92%)
Peak PSS 253.11 MiB 278.37 MiB +25.26 MiB (+9.98%)
Peak RSS 255.66 MiB 281.17 MiB +25.50 MiB (+9.98%)
Peak threads 26 27 +1 (+3.85%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 32 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.053, 2.054, 3.056, 4.058, 4.559, 5.06, 6.062, 7.063, 8.065, 9.067, 10.069, 11.071, 12.072, 13.073, 14.075, 15.076, 16.077, 16.578, 17.078, 18.586, 19.586, 20.587, 21.588, 22.089, 22.59, 23.592, 24.593, 25.595, 26.596, 27.597, 28.599, 29.6, 30.602, 31.603, 32.603, 33.604, 34.605, 35.607]
    y-axis "CPU percent" 0 --> 200
    line [47.83, 113.85, 99.93, 97.72, 155.77, 123.81, 145.69, 107.85, 113.82, 81.85, 89.83, 121.8, 97.84, 61.95, 55.94, 11.99, 33.98, 0, 0, 73.86, 109.96, 137.81, 140.05, 129.87, 127.71, 71.83, 125.88, 117.79, 51.93, 97.83, 11.98, 95.89, 77.85, 11.98, 18, 133.86, 23.97, 107.82]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.051, 1.053, 2.054, 3.056, 4.058, 4.559, 5.06, 6.062, 7.063, 8.065, 9.067, 10.069, 11.071, 12.072, 13.073, 14.075, 15.076, 16.077, 16.578, 17.078, 18.586, 19.586, 20.587, 21.588, 22.089, 22.59, 23.592, 24.593, 25.595, 26.596, 27.597, 28.599, 29.6, 30.602, 31.603, 32.603, 33.604, 34.605, 35.607, 36.531]
    y-axis "Memory MiB" 0 --> 500
    line [21.11, 116.33, 147.09, 188.08, 204.45, 229.28, 238.11, 209.69, 217.18, 230.75, 215.58, 203.89, 228.32, 207.14, 176.6, 190.71, 189.6, 181.94, 176.16, 176.16, 220.56, 198.86, 212.33, 232.32, 255.66, 239.46, 202.54, 215.75, 221.47, 204.11, 191.54, 197.02, 228.36, 220.46, 210.86, 216.16, 230.27, 209.28, 236.43, 0]
    line [18.93, 113.74, 144.51, 185.5, 201.88, 226.47, 235.55, 207.22, 215.21, 228.21, 212.6, 201.4, 225.74, 204.54, 174.03, 188.11, 187, 179.34, 173.58, 173.58, 217.99, 196.3, 209.75, 229.77, 253.11, 236.92, 200, 213.24, 218.95, 201.59, 189.03, 194.53, 226.7, 217.95, 208.34, 213.65, 227.74, 206.76, 233.91, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 3.04, 4.042, 4.543, 5.542, 6.545, 7.547, 8.548, 9.55, 10.552, 11.053, 12.054, 13.055, 14.058, 15.059, 16.061, 17.061, 18.063, 19.564, 20.566, 21.566, 22.568, 23.569, 24.569, 25.57, 26.573, 28.075, 29.077, 30.299, 31.301, 32.303, 33.305, 34.306, 34.806, 35.808, 36.808, 37.81]
    y-axis "CPU percent" 0 --> 200
    line [51.95, 95.89, 97.89, 115.88, 159.73, 154.01, 103.58, 171.66, 33.98, 127.83, 95.82, 135.69, 9.99, 19.99, 115.92, 97.9, 45.86, 61.95, 57.84, 133.86, 131.79, 128.04, 89.83, 99.87, 116.02, 121.86, 61.92, 53.93, 27.98, 76.93, 89.75, 85.76, 2, 55.97, 0, 141.61, 47.97, 109.89]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.037, 1.037, 2.038, 3.04, 4.042, 4.543, 5.542, 6.545, 7.547, 8.548, 9.55, 10.552, 11.053, 12.054, 13.055, 14.058, 15.059, 16.061, 17.061, 18.063, 19.564, 20.566, 21.566, 22.568, 23.569, 24.569, 25.57, 26.573, 28.075, 29.077, 30.299, 31.301, 32.303, 33.305, 34.306, 34.806, 35.808, 36.808, 37.81, 38.722]
    y-axis "Memory MiB" 0 --> 500
    line [22.99, 121.32, 150.33, 200.97, 214.23, 242.48, 229.16, 217.61, 250.56, 229.77, 241.11, 265.93, 281.17, 253.07, 179.8, 210, 199.02, 188.12, 200.25, 187.53, 222.36, 239.59, 245.09, 215.57, 220.7, 258.32, 226.85, 205.8, 193.44, 207.29, 211.23, 208.69, 215.43, 197.56, 208.53, 203.64, 214.77, 193.46, 226.38, 0]
    line [20.94, 118.85, 147.84, 198.42, 211.67, 239.95, 226.61, 214.97, 248.02, 227.22, 238.57, 263.44, 278.37, 250.56, 177.29, 207.38, 196.4, 185.5, 197.63, 184.91, 219.68, 237.59, 242.46, 212.94, 218, 255.69, 224.22, 203.17, 190.81, 204.67, 208.6, 206.06, 212.79, 194.93, 205.89, 201, 212.16, 190.83, 223.78, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.93 s +0.00 s (+0.02%)
Estimated CPU 0.43 s 0.46 s +0.03 s (+6.94%)
Peak PSS 87.49 MiB 89.06 MiB +1.56 MiB (+1.79%)
Peak RSS 89.91 MiB 91.79 MiB +1.89 MiB (+2.10%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor c020b81cec4c → HEAD 37db9e1c3679; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 37.99 s 33.34 s -4.65 s (-12.25%)
Estimated CPU 30.81 s 29.57 s -1.24 s (-4.02%)
Peak PSS 259.60 MiB 300.90 MiB +41.30 MiB (+15.91%)
Peak RSS 261.96 MiB 303.26 MiB +41.30 MiB (+15.77%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 3.038, 4.04, 5.041, 5.542, 6.042, 6.542, 7.043, 7.544, 8.545, 9.546, 10.548, 11.55, 12.552, 13.554, 15.057, 16.059, 17.06, 18.062, 19.064, 20.064, 21.065, 22.067, 23.068, 24.571, 25.573, 26.575, 27.577, 28.579, 29.58, 30.582, 31.584, 32.584, 34.085, 35.086, 36.087, 37.088]
    y-axis "CPU percent" 0 --> 200
    line [55.98, 101.75, 97.85, 97.89, 171.78, 127.82, 157.97, 135.8, 99.87, 79.89, 133.87, 59.89, 67.8, 121.79, 35.96, 5.99, 89.89, 101.77, 7.99, 41.92, 67.9, 107.9, 125.81, 129.7, 131.91, 85.9, 121.81, 83.82, 93.83, 25.96, 25.97, 121.82, 63.9, 4, 0, 112.01, 41.95, 115.69]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.037, 3.038, 4.04, 5.041, 5.542, 6.042, 6.542, 7.043, 7.544, 8.545, 9.546, 10.548, 11.55, 12.552, 13.554, 15.057, 16.059, 17.06, 18.062, 19.064, 20.064, 21.065, 22.067, 23.068, 24.571, 25.573, 26.575, 27.577, 28.579, 29.58, 30.582, 31.584, 32.584, 34.085, 35.086, 36.087, 37.088, 37.988]
    y-axis "Memory MiB" 0 --> 500
    line [23.19, 123.54, 148.86, 179.17, 212.07, 232.34, 239.9, 224.16, 229.4, 214.33, 246.59, 252.08, 234.77, 242.61, 249.69, 194.42, 182.04, 209.27, 207.79, 189.75, 181.95, 224.01, 214.18, 225.12, 243.13, 221.44, 187.72, 250.99, 210.34, 203.05, 200.02, 213.67, 261.96, 230.64, 199.63, 207.51, 210.84, 203.05, 230.5, 0]
    line [21.24, 121.21, 146.53, 176.84, 209.75, 230.02, 237.57, 221.83, 227.03, 212, 244.27, 249.63, 232.3, 240.24, 247.44, 192.07, 179.68, 206.56, 205.43, 187.39, 179.59, 221.65, 211.82, 222.78, 240.77, 217.7, 185.38, 248.64, 207.82, 200.69, 197.66, 211.32, 259.6, 228.28, 197.28, 205.16, 208.48, 200.7, 228.21, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 1.537, 2.038, 3.04, 3.541, 4.041, 4.542, 5.543, 6.544, 7.545, 8.546, 9.547, 10.048, 11.049, 12.05, 13.051, 14.052, 15.054, 16.054, 17.055, 17.556, 18.558, 19.059, 19.56, 20.562, 21.563, 22.565, 23.565, 24.065, 25.066, 26.067, 27.068, 28.069, 29.07, 30.072, 30.572, 31.573, 32.574]
    y-axis "CPU percent" 0 --> 200
    line [61.84, 115.89, 75.79, 99.79, 109.72, 169.91, 135.83, 139.93, 125.92, 115.87, 131.85, 131.98, 129.65, 61.96, 103.91, 111.94, 47.98, 99.75, 48.03, 119.88, 109.88, 133.72, 125.78, 99.76, 41.89, 125.87, 113.72, 28.01, 85.98, 73.95, 15.98, 133.82, 101.87, 2, 2, 105.86, 33.96, 111.9]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 1.537, 2.038, 3.04, 3.541, 4.041, 4.542, 5.543, 6.544, 7.545, 8.546, 9.547, 10.048, 11.049, 12.05, 13.051, 14.052, 15.054, 16.054, 17.055, 17.556, 18.558, 19.059, 19.56, 20.562, 21.563, 22.565, 23.565, 24.065, 25.066, 26.067, 27.068, 28.069, 29.07, 30.072, 30.572, 31.573, 32.574, 33.335]
    y-axis "Memory MiB" 0 --> 500
    line [23.04, 124.35, 141.95, 144.58, 183.97, 196.69, 217.13, 233.52, 230.8, 247.31, 232.63, 242.64, 241.27, 233.42, 203.41, 226.39, 194.61, 183.75, 222.39, 196.14, 213.55, 247.98, 250.8, 303.26, 225.63, 218.23, 228.57, 225.36, 214.5, 222, 198.22, 206.25, 235.31, 216.74, 199.25, 207.68, 213.24, 203.35, 232.84, 0]
    line [21.13, 122.01, 139.61, 142.31, 181.63, 194.39, 214.79, 231.09, 228.48, 245.11, 230.3, 240.18, 238.93, 231.05, 201.04, 224.04, 192.25, 181.38, 220.04, 194.07, 211.19, 245.62, 248.43, 300.9, 223.27, 215.86, 226.21, 223, 212.13, 219.63, 195.85, 203.89, 232.95, 214.38, 196.89, 205.31, 210.88, 200.99, 230.49, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.02 s 19.92 s -0.09 s (-0.47%)
Estimated CPU 0.48 s 0.46 s -0.02 s (-4.15%)
Peak PSS 89.02 MiB 87.53 MiB -1.50 MiB (-1.68%)
Peak RSS 91.11 MiB 89.84 MiB -1.27 MiB (-1.39%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 37db9e1 to 7ea8f0a Compare August 18, 2026 17:55
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 107edf16801d → HEAD 7ea8f0a0d85e; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2
Observed duration 36.46 s 41.39 s +4.93 s (+13.52%)
Estimated CPU 31.51 s 34.26 s +2.75 s (+8.74%)
Peak PSS 342.38 MiB 344.43 MiB +2.05 MiB (+0.60%)
Peak RSS 344.13 MiB 348.84 MiB +4.71 MiB (+1.37%)
Peak threads 26 26 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 30 / 40 +5

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.036, 2.039, 3.042, 3.542, 4.042, 5.044, 6.044, 7.045, 8.047, 9.047, 10.047, 11.049, 12.049, 13.05, 14.052, 14.552, 15.053, 16.054, 17.054, 18.557, 19.558, 20.56, 21.561, 22.561, 23.562, 24.564, 25.565, 26.566, 27.568, 28.57, 29.07, 29.57, 30.572, 31.574, 32.574, 33.576, 34.579, 35.581]
    y-axis "CPU percent" 0 --> 200
    line [45.97, 109.79, 111.7, 95.92, 151.9, 139.81, 112.04, 131.76, 93.86, 112.01, 101.96, 49.91, 100.04, 85.9, 39.96, 0, 4, 27.97, 117.93, 121.87, 107.94, 133.83, 135.96, 69.99, 103.81, 53.97, 89.89, 27.98, 37.89, 115.77, 115.83, 102.02, 75.8, 19.95, 55.96, 93.81, 17.97, 117.75]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.036, 2.039, 3.042, 3.542, 4.042, 5.044, 6.044, 7.045, 8.047, 9.047, 10.047, 11.049, 12.049, 13.05, 14.052, 14.552, 15.053, 16.054, 17.054, 18.557, 19.558, 20.56, 21.561, 22.561, 23.562, 24.564, 25.565, 26.566, 27.568, 28.57, 29.07, 29.57, 30.572, 31.574, 32.574, 33.576, 34.579, 35.581, 36.459]
    y-axis "Memory MiB" 0 --> 500
    line [22.46, 119.34, 148.48, 189.8, 190.23, 206.35, 216.26, 212.82, 245.64, 234.29, 229.66, 228.98, 225.77, 234.24, 191.23, 186.95, 180.57, 178.18, 181.9, 224.93, 214.43, 257.82, 257.69, 230.86, 210.22, 251.69, 182.09, 184.71, 191.66, 202.17, 267.3, 344.13, 335.23, 219.71, 221.39, 227.9, 235.97, 221.11, 249.07, 0]
    line [20.1, 116.67, 145.81, 187.15, 187.58, 203.7, 213.77, 210.65, 243.16, 231.81, 227.23, 226.61, 223.51, 231.98, 188.96, 184.67, 178.3, 175.91, 179.44, 222.67, 212.16, 255.56, 254.57, 228.59, 207.95, 249.42, 179.77, 182.44, 189.38, 199.7, 267.64, 342.38, 332.95, 218.56, 219.11, 225.63, 233.7, 218.88, 246.86, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.042, 2.043, 2.544, 3.046, 3.546, 4.547, 6.05, 7.051, 8.053, 9.055, 10.557, 11.557, 12.559, 13.063, 14.063, 15.063, 16.063, 17.565, 18.566, 19.566, 21.068, 22.07, 23.071, 24.073, 25.575, 26.576, 27.578, 29.081, 30.082, 31.083, 32.588, 33.589, 34.59, 35.591, 37.092, 38.094, 39.098, 40.599]
    y-axis "CPU percent" 0 --> 200
    line [39.97, 107.92, 127.78, 103.74, 101.89, 165.68, 125.64, 109.82, 109.71, 61.88, 75.9, 93.86, 69.87, 0, 17.99, 20.01, 61.97, 67.92, 59.93, 111.9, 101.87, 125.78, 125.86, 127.77, 55.92, 97.84, 95.83, 67.9, 6, 11.99, 115.09, 98, 59.9, 56.01, 63.97, 109.93, 27.92, 113.9]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.043, 1.042, 2.043, 2.544, 3.046, 3.546, 4.547, 6.05, 7.051, 8.053, 9.055, 10.557, 11.557, 12.559, 13.063, 14.063, 15.063, 16.063, 17.565, 18.566, 19.566, 21.068, 22.07, 23.071, 24.073, 25.575, 26.576, 27.578, 29.081, 30.082, 31.083, 32.588, 33.589, 34.59, 35.591, 37.092, 38.094, 39.098, 40.599, 41.387]
    y-axis "Memory MiB" 0 --> 500
    line [23.07, 121.2, 147.33, 181.46, 196.71, 191.69, 235.44, 232.72, 240.67, 233.93, 202.33, 211.19, 231.39, 185.44, 174.52, 176.75, 178.67, 194.21, 190.03, 182.48, 220.79, 200.79, 231.95, 243.95, 255.89, 206.02, 243.09, 217.58, 199.13, 196.09, 199.42, 327.18, 348.84, 225.07, 209.53, 193.2, 210.65, 198.73, 239.58, 0]
    line [20.65, 118.42, 144.56, 178.54, 194.32, 188.86, 232.54, 229.82, 237.81, 231.09, 199.47, 209.05, 228.56, 182.6, 171.63, 173.86, 175.81, 191.37, 187.16, 179.64, 217.96, 197.92, 229.12, 241, 253.04, 203.13, 240.25, 214.73, 196.29, 193.25, 196.58, 325.01, 344.43, 222.23, 206.69, 190.36, 207.84, 195.89, 236.8, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.16 s 20.06 s -0.10 s (-0.49%)
Estimated CPU 0.52 s 0.46 s -0.06 s (-11.49%)
Peak PSS 84.45 MiB 85.89 MiB +1.45 MiB (+1.71%)
Peak RSS 87.06 MiB 88.46 MiB +1.40 MiB (+1.61%)
Peak threads 19 18 -1 (-5.26%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 107edf16801d → HEAD 9441c07c3a8b; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 35.15 s 38.62 s +3.47 s (+9.87%)
Estimated CPU 31.51 s 30.96 s -0.55 s (-1.74%)
Peak PSS 331.78 MiB 285.06 MiB -46.72 MiB (-14.08%)
Peak RSS 334.18 MiB 287.93 MiB -46.25 MiB (-13.84%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 2.538, 3.038, 3.539, 4.039, 5.04, 6.041, 7.041, 8.041, 9.042, 10.043, 11.043, 12.043, 13.044, 14.045, 15.045, 16.046, 17.047, 18.048, 18.549, 19.55, 20.552, 21.553, 22.554, 23.556, 24.557, 25.558, 26.56, 27.561, 28.062, 28.562, 29.563, 30.565, 31.566, 32.567, 33.569, 34.569]
    y-axis "CPU percent" 0 --> 200
    line [39.95, 107.89, 124.07, 105.95, 89.9, 163.83, 151.79, 117.82, 152.02, 52, 87.87, 129.92, 93.97, 111.97, 99.94, 57.94, 98, 17.98, 95.89, 123.87, 129.81, 137.73, 52, 115.85, 100.04, 77.78, 77.94, 19.97, 103.67, 125.87, 99.84, 135.77, 111.98, 2, 0, 132.07, 63.89, 123.99]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.038, 2.538, 3.038, 3.539, 4.039, 5.04, 6.041, 7.041, 8.041, 9.042, 10.043, 11.043, 12.043, 13.044, 14.045, 15.045, 16.046, 17.047, 18.048, 18.549, 19.55, 20.552, 21.553, 22.554, 23.556, 24.557, 25.558, 26.56, 27.561, 28.062, 28.562, 29.563, 30.565, 31.566, 32.567, 33.569, 34.569, 35.154]
    y-axis "Memory MiB" 0 --> 500
    line [23.09, 118.95, 151.7, 179.16, 188.84, 190.94, 212.24, 249.72, 224.29, 258.99, 228.94, 247.09, 286.28, 249.86, 267.18, 193.87, 178.81, 214.05, 192.14, 210.74, 246.02, 239.06, 224.48, 210.13, 245, 219.64, 220.16, 197.12, 211.93, 265.02, 327.04, 334.18, 241.33, 243.63, 201.88, 223.29, 215.16, 209.19, 244.86, 0]
    line [21.06, 116.84, 149.39, 176.85, 186.52, 191.19, 209.93, 247.37, 219.53, 256.61, 226.56, 244.71, 284.18, 247.5, 264.81, 191.46, 176.41, 211.65, 189.74, 208.34, 243.62, 237.28, 220.2, 207.73, 242.59, 217.23, 217.76, 194.72, 209.57, 262.62, 324.35, 331.78, 238.93, 240.87, 199.48, 220.88, 212.76, 206.79, 242.46, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 3.038, 3.539, 4.039, 4.54, 5.541, 6.541, 7.542, 8.544, 10.045, 11.047, 12.049, 12.549, 13.05, 14.051, 15.053, 16.554, 17.555, 18.557, 19.558, 20.559, 21.56, 23.063, 24.064, 25.065, 26.067, 27.068, 28.069, 29.572, 30.573, 31.575, 32.576, 33.577, 34.579, 36.081, 37.082, 38.084]
    y-axis "CPU percent" 0 --> 200
    line [49.85, 117.88, 92, 71.96, 159.92, 151.77, 131.78, 101.94, 121.84, 87.83, 82.03, 145.59, 77.89, 0, 4, 38, 101.75, 7.99, 43.97, 75.91, 99.72, 127.86, 127.81, 131.72, 79.87, 99.87, 71.89, 89.89, 21.97, 57.93, 133.94, 31.96, 21.97, 53.94, 5.99, 89.9, 77.77, 131.79]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.038, 3.038, 3.539, 4.039, 4.54, 5.541, 6.541, 7.542, 8.544, 10.045, 11.047, 12.049, 12.549, 13.05, 14.051, 15.053, 16.554, 17.555, 18.557, 19.558, 20.559, 21.56, 23.063, 24.064, 25.065, 26.067, 27.068, 28.069, 29.572, 30.573, 31.575, 32.576, 33.577, 34.579, 36.081, 37.082, 38.084, 38.623]
    y-axis "Memory MiB" 0 --> 500
    line [22.94, 124.19, 168.5, 196.8, 186.96, 229.1, 251.7, 251.79, 264.69, 269.25, 242.12, 215.48, 245.5, 223.97, 223.97, 171.67, 190.49, 205.2, 192.57, 183.09, 223.01, 209.89, 220.28, 241.79, 228.21, 213.51, 244.14, 207.04, 201.82, 199.95, 202.5, 287.93, 233.04, 206.49, 224.47, 203.11, 208.34, 213.85, 256.39, 0]
    line [20.95, 121.83, 166.15, 194.44, 184.59, 226.75, 249.36, 249.51, 262.32, 266.89, 239.75, 213.12, 242.57, 221.61, 221.61, 169.31, 188.14, 202.84, 190.21, 180.72, 220.45, 207.53, 219.97, 239.43, 225.84, 211.13, 241.58, 204.66, 195.1, 197.57, 200.12, 285.06, 230.67, 204.12, 222.09, 200.81, 205.96, 211.48, 254.01, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.92 s +0.00 s (+0.01%)
Estimated CPU 0.46 s 0.45 s -0.01 s (-1.95%)
Peak PSS 88.21 MiB 86.20 MiB -2.01 MiB (-2.28%)
Peak RSS 90.42 MiB 88.48 MiB -1.94 MiB (-2.14%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 107edf16801d → HEAD e4d412531937; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 42.04 s 39.32 s -2.72 s (-6.47%)
Estimated CPU 33.55 s 35.27 s +1.72 s (+5.14%)
Peak PSS 348.07 MiB 345.71 MiB -2.36 MiB (-0.68%)
Peak RSS 350.36 MiB 347.96 MiB -2.40 MiB (-0.68%)
Peak threads 26 27 +1 (+3.85%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.039, 2.539, 3.539, 4.541, 5.542, 6.044, 7.045, 8.045, 9.548, 10.549, 11.55, 13.052, 14.052, 15.054, 15.556, 16.557, 17.558, 18.559, 20.06, 21.062, 22.064, 23.565, 24.565, 25.566, 27.069, 28.069, 29.07, 30.571, 31.572, 32.573, 34.075, 35.077, 36.078, 37.58, 38.582, 39.583, 41.085]
    y-axis "CPU percent" 0 --> 500
    line [41.95, 107.77, 113.96, 91.96, 169.7, 213.95, 163.53, 41.95, 131.83, 79.89, 159.92, 33.94, 19.97, 143.83, 67.9, 0, 19.98, 19.96, 95.93, 4, 51.92, 69.96, 97.78, 108.1, 131.86, 63.9, 122.05, 111.79, 88.07, 45.95, 17.97, 73.88, 59.93, 4, 71.95, 0, 35.96, 105.91]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.039, 2.539, 3.539, 4.541, 5.542, 6.044, 7.045, 8.045, 9.548, 10.549, 11.55, 13.052, 14.052, 15.054, 15.556, 16.557, 17.558, 18.559, 20.06, 21.062, 22.064, 23.565, 24.565, 25.566, 27.069, 28.069, 29.07, 30.571, 31.572, 32.573, 34.075, 35.077, 36.078, 37.58, 38.582, 39.583, 41.085, 42.04]
    y-axis "Memory MiB" 0 --> 500
    line [22.78, 124.76, 166.65, 171.75, 183.82, 255.93, 329.5, 350.36, 343.31, 339.96, 319.07, 340.39, 317.06, 202.87, 226.71, 207.77, 207.77, 200.32, 205.65, 209.37, 184.82, 183.14, 219, 203.74, 234.89, 249.47, 215.89, 231.54, 234.93, 211.11, 202.92, 217.59, 204.52, 206.87, 186.55, 197.8, 191.21, 183.73, 222.05, 0]
    line [20.85, 122.63, 164.42, 169.51, 181.7, 253.58, 327.27, 348.07, 341.08, 337.66, 316.84, 337.4, 314.84, 201.07, 224.47, 205.52, 205.52, 198.07, 203.4, 207.12, 182.57, 180.9, 216.71, 201.49, 238.64, 247.28, 213.64, 229.29, 232.68, 208.85, 200.67, 215.33, 202.26, 204.92, 184.3, 195.33, 188.96, 181.48, 219.93, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.037, 3.038, 3.539, 4.039, 4.54, 5.041, 5.541, 6.544, 7.546, 9.047, 10.048, 11.05, 12.051, 13.052, 14.554, 15.555, 16.555, 17.557, 18.558, 20.061, 21.062, 22.062, 23.064, 24.064, 25.066, 26.568, 27.569, 28.571, 29.573, 30.573, 32.075, 33.076, 34.076, 35.076, 36.077, 37.579, 38.581]
    y-axis "CPU percent" 0 --> 500
    line [37.96, 109.95, 99.97, 119.67, 169.86, 187.85, 145.72, 191.73, 169.69, 131.74, 137.72, 131.98, 121.73, 119.92, 89.91, 49.89, 79.97, 37.99, 55.9, 25.98, 135.7, 141.93, 133.93, 57.92, 129.91, 109.87, 67.91, 7.99, 49.9, 107.7, 101.96, 3.99, 3.99, 68.02, 39.96, 23.99, 53.94, 111.67]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.036, 2.037, 3.038, 3.539, 4.039, 4.54, 5.041, 5.541, 6.544, 7.546, 9.047, 10.048, 11.05, 12.051, 13.052, 14.554, 15.555, 16.555, 17.557, 18.558, 20.061, 21.062, 22.062, 23.064, 24.064, 25.066, 26.568, 27.569, 28.571, 29.573, 30.573, 32.075, 33.076, 34.076, 35.076, 36.077, 37.579, 38.581, 39.318]
    y-axis "Memory MiB" 0 --> 500
    line [23.11, 124.12, 168.52, 185.44, 203.36, 241.68, 251.44, 327.57, 328.64, 344.9, 328.48, 343.29, 342.76, 326.48, 343.42, 263.58, 266.34, 265.84, 246.9, 248.66, 235.86, 255.98, 268.96, 248.99, 210.16, 229.59, 217.29, 186.39, 197.52, 201.84, 327.21, 347.96, 215.23, 207.66, 222.95, 225.19, 209.59, 193.94, 236.7, 0]
    line [21.17, 121.89, 166.29, 183.21, 201.12, 240.66, 249.2, 325.29, 327.33, 342.66, 326.23, 341.56, 340.41, 324.27, 341.2, 261.35, 264.09, 263.5, 244.74, 246.5, 233.61, 253.73, 266.65, 246.74, 207.91, 227.92, 215.04, 184.18, 195.38, 199.46, 325.05, 345.71, 212.98, 205.41, 221.04, 222.94, 207.56, 191.69, 234.46, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.93 s 19.92 s -0.01 s (-0.06%)
Estimated CPU 0.45 s 0.44 s -0.01 s (-2.21%)
Peak PSS 87.52 MiB 86.77 MiB -0.75 MiB (-0.86%)
Peak RSS 88.77 MiB 89.10 MiB +0.33 MiB (+0.37%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from e4d4125 to 559fe2e Compare August 20, 2026 10:49
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 2c186e3c4abf → HEAD 559fe2e155a9; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 37; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2
Observed duration 43.77 s 41.61 s -2.17 s (-4.95%)
Estimated CPU 33.81 s 33.60 s -0.21 s (-0.62%)
Peak PSS 274.28 MiB 268.12 MiB -6.17 MiB (-2.25%)
Peak RSS 276.57 MiB 270.87 MiB -5.70 MiB (-2.06%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 30 / 40 +5

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.539, 3.54, 4.542, 5.043, 5.543, 6.044, 7.045, 7.546, 8.547, 10.048, 11.049, 12.051, 13.553, 14.554, 16.056, 17.056, 18.559, 19.561, 21.063, 22.064, 23.064, 24.566, 25.567, 27.07, 28.071, 29.574, 30.575, 32.077, 33.077, 34.079, 35.582, 36.584, 38.086, 39.087, 40.588, 41.589, 43.092]
    y-axis "CPU percent" 0 --> 200
    line [57.94, 111.83, 53.95, 81.89, 149.87, 181.82, 67.86, 143.95, 135.83, 125.79, 102.02, 81.87, 73.91, 77.89, 0, 3.99, 47.95, 77.92, 3.99, 57.95, 89.87, 67.93, 116.08, 139.73, 135.69, 101.88, 67.94, 103.94, 87.77, 41.96, 25.96, 119.87, 109.71, 29.97, 21.97, 58.02, 25.97, 125.75]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.539, 3.54, 4.542, 5.043, 5.543, 6.044, 7.045, 7.546, 8.547, 10.048, 11.049, 12.051, 13.553, 14.554, 16.056, 17.056, 18.559, 19.561, 21.063, 22.064, 23.064, 24.566, 25.567, 27.07, 28.071, 29.574, 30.575, 32.077, 33.077, 34.079, 35.582, 36.584, 38.086, 39.087, 40.588, 41.589, 43.092, 43.775]
    y-axis "Memory MiB" 0 --> 500
    line [23.06, 121.31, 148.54, 177.1, 185.07, 228.2, 227.71, 235.2, 207.62, 216.11, 236.63, 204.56, 213.21, 212.7, 205.93, 191.66, 191.01, 194.14, 201.26, 187.13, 192.09, 217.92, 194.81, 212.55, 245.04, 223.68, 213.67, 276.57, 245, 234.03, 228.93, 233.91, 241.02, 213.64, 198.06, 188.38, 201.22, 187.64, 235.13, 0]
    line [21.11, 119.06, 146.33, 174.85, 182.83, 225.96, 225.47, 233.08, 205.36, 213.84, 234.39, 202.29, 211.12, 210.43, 203.65, 189.38, 188.72, 191.86, 198.99, 184.85, 189.8, 215.57, 192.53, 211.41, 242.76, 221.39, 212.09, 274.28, 242.68, 231.75, 226.65, 231.63, 238.73, 211.36, 195.7, 186.1, 198.94, 185.37, 233.03, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.039, 2.041, 2.542, 3.043, 3.544, 5.047, 6.049, 7.049, 8.549, 9.551, 11.054, 12.056, 13.056, 14.559, 15.561, 17.062, 18.064, 19.066, 19.567, 20.569, 21.571, 23.072, 24.073, 25.075, 26.577, 27.579, 29.081, 30.083, 31.083, 32.585, 33.586, 35.089, 36.091, 37.093, 38.595, 39.597, 41.098, 41.598]
    y-axis "CPU percent" 0 --> 200
    line [57.92, 3.99, 45.93, 95.84, 129.68, 93.74, 169.71, 150.03, 103.83, 137.67, 55.91, 67.89, 133.85, 35.91, 87.9, 19.97, 47.89, 5.99, 0, 123.79, 47.93, 81.97, 49.93, 133.72, 131.92, 0, 133.64, 103.77, 42.01, 105.95, 9.99, 103.76, 39.93, 51.93, 125.63, 29.94, 135.97, 69.98]
Loading
xychart-beta
    title "HEAD memory: RSS"
    x-axis "Elapsed seconds" [0.038, 1.039, 2.041, 2.542, 3.043, 3.544, 5.047, 6.049, 7.049, 8.549, 9.551, 11.054, 12.056, 13.056, 14.559, 15.561, 17.062, 18.064, 19.066, 19.567, 20.569, 21.571, 23.072, 24.073, 25.075, 26.577, 27.579, 29.081, 30.083, 31.083, 32.585, 33.586, 35.089, 36.091, 37.093, 38.595, 39.597, 41.098, 41.598, 41.608]
    y-axis "Memory MiB" 0 --> 500
    line [22.86, 121.18, 131.73, 140.25, 151.56, 178.84, 190.59, 230.48, 263.64, 221.36, 231.49, 216.55, 238.61, 270.87, 245.07, 255.49, 227.5, 224.22, 219.34, 219.1, 257.93, 205.27, 211.66, 235.65, 240.83, 229.62, 215.71, 222.16, 217.04, 202.74, 197.8, 197.43, 205.13, 214.31, 195.55, 196.12, 189.12, 245.87, 0, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.95 s 19.94 s -0.01 s (-0.06%)
Estimated CPU 0.48 s 0.51 s +0.03 s (+6.00%)
Peak PSS 89.24 MiB 86.31 MiB -2.93 MiB (-3.29%)
Peak RSS 91.42 MiB 88.54 MiB -2.89 MiB (-3.16%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 2c186e3c4abf → HEAD 4695bb3177b4; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 38.75 s 46.73 s +7.98 s (+20.59%)
Estimated CPU 33.51 s 36.25 s +2.73 s (+8.16%)
Peak PSS 301.21 MiB 277.14 MiB -24.07 MiB (-7.99%)
Peak RSS 303.43 MiB 278.63 MiB -24.80 MiB (-8.17%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.037, 2.038, 3.541, 4.542, 5.544, 6.545, 7.547, 8.048, 8.548, 10.051, 11.052, 12.052, 13.053, 14.055, 15.056, 16.558, 17.559, 18.559, 19.56, 20.56, 21.561, 23.061, 24.062, 25.064, 26.064, 27.066, 28.068, 29.068, 29.568, 30.57, 31.571, 32.071, 32.571, 33.573, 34.575, 36.076, 37.078, 38.08]
    y-axis "CPU percent" 0 --> 200
    line [53.92, 67.97, 83.87, 133.82, 83.87, 131.82, 121.8, 167.64, 85.95, 123.79, 141.8, 90, 73.88, 49.92, 24, 43.94, 117.84, 59.94, 109.88, 122.03, 123.84, 138.09, 133.94, 37.94, 79.88, 7.99, 65.9, 119.94, 101.95, 41.92, 58.02, 0, 2, 65.9, 133.72, 25.96, 51.86, 117.8]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.036, 1.037, 2.038, 3.541, 4.542, 5.544, 6.545, 7.547, 8.048, 8.548, 10.051, 11.052, 12.052, 13.053, 14.055, 15.056, 16.558, 17.559, 18.559, 19.56, 20.56, 21.561, 23.061, 24.062, 25.064, 26.064, 27.066, 28.068, 29.068, 29.568, 30.57, 31.571, 32.071, 32.571, 33.573, 34.575, 36.076, 37.078, 38.08, 38.752]
    y-axis "Memory MiB" 0 --> 500
    line [22.96, 122.04, 158, 200.96, 209.61, 250.53, 238.28, 254.89, 246.45, 229.9, 244.18, 245.14, 223.44, 196.73, 206.68, 190.67, 187.64, 231.16, 185.63, 202.24, 251.29, 225.96, 221.56, 222.64, 199.06, 184.63, 195.66, 198.82, 303.43, 210.34, 230.79, 224.61, 224.68, 209.69, 222, 223.07, 208.62, 194.57, 239.73, 0]
    line [21.05, 119.79, 155.75, 198.71, 207.38, 248.26, 235.96, 252.58, 244.14, 227.58, 241.87, 242.82, 221.22, 195.25, 204.37, 188.35, 185.33, 228.85, 183.32, 200.57, 248.97, 223.66, 219.24, 220.32, 196.74, 182.31, 193.36, 196.5, 301.21, 208.02, 228.47, 222.29, 222.37, 207.37, 219.79, 220.76, 206.3, 192.26, 237.42, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.038, 1.539, 2.54, 4.042, 5.044, 6.046, 6.547, 8.049, 9.05, 10.55, 12.053, 13.054, 14.555, 15.557, 17.058, 18.058, 18.558, 19.558, 21.059, 22.061, 23.564, 25.066, 26.067, 27.57, 28.571, 30.074, 31.577, 32.577, 34.08, 35.583, 36.585, 38.087, 39.087, 40.589, 42.09, 43.092, 44.593, 45.594]
    y-axis "CPU percent" 0 --> 200
    line [55.93, 97.86, 6, 93.76, 59.83, 179.49, 29.97, 157.85, 139.84, 107.98, 3.99, 113.98, 137.8, 97.88, 113.97, 0, 2, 2, 63.89, 69.86, 25.96, 111.86, 37.94, 107.75, 109.97, 113.78, 61.91, 142.08, 109.83, 91.79, 71.84, 43.95, 113.99, 18, 67.94, 2, 27.96, 119.83]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.037, 1.038, 1.539, 2.54, 4.042, 5.044, 6.046, 6.547, 8.049, 9.05, 10.55, 12.053, 13.054, 14.555, 15.557, 17.058, 18.058, 18.558, 19.558, 21.059, 22.061, 23.564, 25.066, 26.067, 27.57, 28.571, 30.074, 31.577, 32.577, 34.08, 35.583, 36.585, 38.087, 39.087, 40.589, 42.09, 43.092, 44.593, 45.594, 46.733]
    y-axis "Memory MiB" 0 --> 500
    line [22.96, 124.13, 163.24, 154.75, 192.07, 197.18, 219.83, 209.28, 247.25, 219.66, 263.96, 225.44, 221.19, 237.44, 217.61, 214.23, 202.1, 201.16, 204.46, 200.54, 203.91, 191, 219.16, 183.99, 205.01, 255.07, 278.63, 203.06, 243.5, 241.63, 224.48, 183.86, 200.4, 204.93, 197.24, 208.5, 179.56, 188.02, 225.78, 0]
    line [21, 121.82, 160.55, 152.45, 189.76, 194.87, 217.52, 206.97, 244.87, 217.28, 261.78, 223.06, 218.81, 235.06, 215.22, 210.84, 199.72, 198.78, 202.08, 198.85, 201.71, 188.58, 216.8, 181.61, 202.67, 252.7, 277.14, 200.68, 241.12, 239.37, 222.11, 181.48, 198.02, 202.55, 194.86, 206.12, 177.18, 185.63, 223.4, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.94 s 19.95 s +0.00 s (+0.02%)
Estimated CPU 0.49 s 0.49 s +0.00 s (+0.20%)
Peak PSS 88.02 MiB 87.67 MiB -0.35 MiB (-0.40%)
Peak RSS 90.30 MiB 89.94 MiB -0.37 MiB (-0.41%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 2c186e3c4abf → HEAD 26bac7b2ebca; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 41.93 s 35.53 s -6.40 s (-15.27%)
Estimated CPU 30.13 s 30.41 s +0.28 s (+0.95%)
Peak PSS 263.67 MiB 274.63 MiB +10.96 MiB (+4.16%)
Peak RSS 266.15 MiB 277.22 MiB +11.07 MiB (+4.16%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.04, 2.042, 2.542, 3.042, 3.543, 4.545, 5.547, 6.047, 7.049, 8.05, 9.551, 10.553, 11.554, 13.057, 14.058, 15.06, 16.561, 17.566, 18.568, 20.069, 21.07, 22.072, 23.574, 24.576, 25.576, 27.078, 28.08, 29.081, 30.582, 31.583, 32.583, 34.085, 35.086, 36.086, 37.588, 38.589, 39.59, 41.092]
    y-axis "CPU percent" 0 --> 200
    line [31.98, 43.93, 104.04, 121.91, 97.77, 103.92, 127.65, 159.83, 107.83, 172.1, 59.91, 59.92, 101.87, 0, 67.89, 97.93, 4, 43.57, 49.98, 27.97, 97.8, 97.87, 123.89, 109.86, 39.94, 99.88, 33.95, 69.92, 7.99, 4, 4, 0, 111.84, 45.96, 7.98, 2, 149.92, 109.92]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.039, 1.04, 2.042, 2.542, 3.042, 3.543, 4.545, 5.547, 6.047, 7.049, 8.05, 9.551, 10.553, 11.554, 13.057, 14.058, 15.06, 16.561, 17.566, 18.568, 20.069, 21.07, 22.072, 23.574, 24.576, 25.576, 27.078, 28.08, 29.081, 30.582, 31.583, 32.583, 34.085, 35.086, 36.086, 37.588, 38.589, 39.59, 41.092, 41.929]
    y-axis "Memory MiB" 0 --> 500
    line [22.9, 121.59, 143.76, 146.44, 180.45, 193.39, 210.09, 245.41, 238.64, 216.7, 245.15, 227.49, 236.93, 245.24, 186.13, 188.29, 200.59, 185.89, 179.88, 184.65, 184.41, 196.5, 246.78, 266.15, 235.89, 206.62, 222.41, 209.33, 198.39, 200.73, 201.05, 198.18, 197.71, 233.55, 207.7, 182.93, 188.18, 194.97, 223.46, 0]
    line [20.82, 119.13, 141.29, 143.97, 177.99, 190.93, 207.64, 242.94, 236.19, 214.24, 242.68, 225.04, 234.47, 242.53, 183.61, 185.77, 199.75, 183.38, 177.37, 182.42, 181.53, 193.99, 244.27, 263.67, 233.41, 204.11, 219.9, 206.83, 195.72, 197.7, 198.55, 195.68, 195.23, 231.07, 205.22, 180.45, 185.7, 192.49, 220.99, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.034, 2.036, 3.037, 4.038, 4.538, 5.04, 6.041, 7.042, 8.043, 9.044, 10.045, 10.547, 11.047, 12.049, 13.05, 14.052, 15.053, 16.054, 17.054, 18.055, 18.555, 19.556, 20.557, 21.559, 22.561, 23.562, 24.564, 25.565, 26.567, 27.568, 28.569, 29.57, 30.571, 31.572, 32.073, 32.573, 33.574, 34.575]
    y-axis "CPU percent" 0 --> 200
    line [55.97, 117.95, 105.96, 131.94, 167.71, 129.61, 137.8, 147.88, 116.05, 133.83, 123.76, 113.7, 81.93, 71.82, 53.93, 11.99, 35.97, 105.93, 26, 99.9, 137.86, 140.01, 131.76, 119.86, 121.64, 77.9, 117.76, 41.97, 83.93, 5.99, 71.88, 72.01, 9.99, 51.93, 0, 120.03, 37.95, 109.82]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.034, 2.036, 3.037, 4.038, 4.538, 5.04, 6.041, 7.042, 8.043, 9.044, 10.045, 10.547, 11.047, 12.049, 13.05, 14.052, 15.053, 16.054, 17.054, 18.055, 18.555, 19.556, 20.557, 21.559, 22.561, 23.562, 24.564, 25.565, 26.567, 27.568, 28.569, 29.57, 30.571, 31.572, 32.073, 32.573, 33.574, 34.575, 35.526]
    y-axis "Memory MiB" 0 --> 500
    line [23.13, 122.37, 151.68, 192.79, 228.56, 241.55, 257.73, 237.88, 260.65, 238.49, 241.9, 274.17, 277.22, 262.56, 252.26, 193.88, 197.04, 195.35, 219.96, 195.68, 206.32, 210.55, 235.75, 258.04, 219.37, 226.54, 226.3, 205.04, 188.08, 205.28, 202.28, 222.46, 206.12, 204.21, 226.5, 226.57, 221.48, 210.7, 246.8, 0]
    line [21.05, 119.92, 149.19, 190.35, 226.13, 241.1, 255.19, 235.32, 257.99, 235.93, 239.35, 271.61, 274.63, 259.97, 249.67, 191.3, 194.45, 192.76, 217.47, 193.12, 203.73, 207.96, 233.16, 253.8, 216.78, 223.94, 223.71, 202.44, 185.49, 202.79, 199.71, 219.87, 203.8, 201.62, 223.91, 223.98, 218.91, 207.83, 244.09, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.93 s +0.02 s (+0.10%)
Estimated CPU 0.43 s 0.44 s +0.01 s (+2.31%)
Peak PSS 88.83 MiB 88.55 MiB -0.27 MiB (-0.31%)
Peak RSS 91.20 MiB 90.88 MiB -0.33 MiB (-0.36%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 26bac7b to 20be383 Compare August 23, 2026 17:26
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 67e2ff6a1872 → HEAD 20be38395fe8; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 179 / 240 0 (0.00%)
Contract fill 74.58% 74.58% 0.00 pp (0.00%)
Sites with rows 37 / 48 37 / 48 0 (0.00%)
Sites meeting row contract 35 / 48 35 / 48 0 (0.00%)
Unexpected empty sites 11 11 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 34.10 s 39.70 s +5.60 s (+16.43%)
Estimated CPU 31.15 s 32.86 s +1.71 s (+5.47%)
Peak PSS 354.69 MiB 344.03 MiB -10.66 MiB (-3.00%)
Peak RSS 357.21 MiB 347.29 MiB -9.92 MiB (-2.78%)
Peak threads 26 26 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 2.538, 3.039, 3.54, 4.04, 4.541, 5.041, 6.043, 6.544, 7.546, 8.548, 9.55, 10.55, 11.551, 12.552, 13.554, 14.554, 15.555, 16.556, 17.558, 18.059, 19.059, 20.06, 21.061, 22.066, 23.065, 24.066, 25.068, 26.069, 27.07, 28.074, 29.076, 29.577, 30.576, 31.576, 32.576, 33.578]
    y-axis "CPU percent" 0 --> 200
    line [17.98, 109.69, 125.79, 93.8, 79.92, 159.91, 133.86, 157.79, 125.63, 135.85, 105.69, 101.77, 125.81, 95.9, 95.88, 111.88, 47.86, 102.01, 47.95, 99.88, 127.83, 139.77, 147.96, 47.94, 113.89, 95.84, 76.01, 5.99, 51.86, 121.94, 99.98, 71.86, 9.98, 2, 0, 138.05, 78.01, 131.64]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.037, 2.538, 3.039, 3.54, 4.04, 4.541, 5.041, 6.043, 6.544, 7.546, 8.548, 9.55, 10.55, 11.551, 12.552, 13.554, 14.554, 15.555, 16.556, 17.558, 18.059, 19.059, 20.06, 21.061, 22.066, 23.065, 24.066, 25.068, 26.069, 27.07, 28.074, 29.076, 29.577, 30.576, 31.576, 32.576, 33.578, 34.1]
    y-axis "Memory MiB" 0 --> 500
    line [22.79, 112.35, 149.55, 176.64, 186.8, 186.65, 208.3, 230.3, 231.67, 212.12, 244.68, 219.32, 251.62, 249.41, 221.2, 234.72, 207.94, 189.69, 217.31, 196.24, 210.39, 242.54, 242.44, 214.93, 197.98, 254, 207.64, 209.11, 208.07, 202.7, 295.78, 357.21, 239.48, 226.73, 226.75, 238.86, 245.48, 229.14, 252.12, 0]
    line [20.83, 110.18, 147.25, 173.42, 184.5, 184.62, 206, 227.86, 229.27, 209.71, 242.28, 216.91, 249.21, 246.55, 218.84, 232.35, 205.47, 187.32, 214.92, 193.84, 207.9, 240.42, 240.17, 212.54, 195.58, 251.6, 205.12, 206.71, 205.52, 200.15, 293.31, 354.69, 237.21, 224.2, 224.22, 236.33, 244.59, 226.66, 249.6, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 3.039, 3.54, 4.04, 4.541, 5.541, 6.542, 8.044, 9.046, 10.048, 11.049, 12.049, 13.549, 14.551, 15.552, 16.554, 18.055, 19.056, 20.058, 21.058, 22.059, 23.56, 24.562, 25.564, 26.565, 28.067, 29.069, 30.071, 31.073, 32.075, 32.575, 33.576, 34.578, 35.579, 36.581, 38.082, 39.084]
    y-axis "CPU percent" 0 --> 200
    line [27.97, 117.85, 101.95, 95.95, 175.91, 125.84, 139.83, 91.95, 111.93, 141.58, 123.79, 91.92, 0, 2, 9.99, 89.9, 103.79, 39.99, 93.95, 85.92, 129.83, 142.02, 127.75, 87.89, 105.8, 111.89, 77.89, 7.99, 13.97, 97.88, 127.74, 100.01, 55.91, 17.97, 15.98, 37.94, 57.93, 123.73]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.038, 3.039, 3.54, 4.04, 4.541, 5.541, 6.542, 8.044, 9.046, 10.048, 11.049, 12.049, 13.549, 14.551, 15.552, 16.554, 18.055, 19.056, 20.058, 21.058, 22.059, 23.56, 24.562, 25.564, 26.565, 28.067, 29.069, 30.071, 31.073, 32.075, 32.575, 33.576, 34.578, 35.579, 36.581, 38.082, 39.084, 39.703]
    y-axis "Memory MiB" 0 --> 500
    line [23.08, 117.92, 153.32, 186.29, 179.66, 214.2, 233.46, 234.32, 229.06, 224.03, 279.99, 238.69, 226.05, 209.92, 169.21, 177.63, 199.27, 199.61, 177.59, 225.33, 208.83, 218.28, 233.54, 228.49, 192.32, 241.29, 241.75, 231.45, 234.55, 248.89, 289.06, 338.21, 347.29, 235.22, 220.36, 211.97, 214.28, 243.07, 284.91, 0]
    line [21.06, 115.51, 150.93, 183.88, 177.5, 211.61, 231.05, 232.79, 226.65, 221.61, 277.57, 236.32, 223.62, 207.49, 166.76, 175.17, 196.82, 197.14, 175.12, 222.86, 206.36, 215.81, 231.07, 226.02, 189.85, 238.82, 239.05, 228.84, 232.23, 246.42, 286.32, 335.74, 344.03, 232.72, 217.89, 209.45, 212.6, 244.66, 282.44, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.92 s 19.92 s -0.00 s (-0.01%)
Estimated CPU 0.43 s 0.43 s 0.00 s (0.00%)
Peak PSS 88.60 MiB 88.52 MiB -0.08 MiB (-0.10%)
Peak RSS 90.96 MiB 90.63 MiB -0.34 MiB (-0.37%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 20be383 to 9d10f1b Compare August 25, 2026 15:19
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor 3cbc3c2b495a → HEAD 9d10f1bb168d; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 179 / 240 184 / 240 +5 (+2.79%)
Contract fill 74.58% 76.67% +2.09 pp (+2.80%)
Sites with rows 37 / 48 38 / 48 +1 (+2.70%)
Sites meeting row contract 35 / 48 36 / 48 +1 (+2.86%)
Unexpected empty sites 11 10 -1 (-9.09%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 36; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2
Observed duration 42.92 s 43.18 s +0.26 s (+0.60%)
Estimated CPU 33.06 s 31.21 s -1.85 s (-5.59%)
Peak PSS 335.36 MiB 284.97 MiB -50.40 MiB (-15.03%)
Peak RSS 337.60 MiB 287.00 MiB -50.60 MiB (-14.99%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 25 / 40 30 / 40 +5

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.051, 2.053, 2.554, 3.556, 5.057, 6.058, 7.06, 8.062, 8.563, 9.564, 11.066, 12.068, 13.069, 14.571, 15.572, 16.574, 18.075, 19.076, 20.578, 21.579, 22.588, 24.091, 25.091, 26.592, 27.592, 28.593, 30.095, 31.099, 32.599, 33.601, 34.603, 35.603, 36.104, 37.105, 38.106, 39.609, 40.609, 42.111]
    y-axis "CPU percent" 0 --> 200
    line [5.95, 107.84, 113.79, 91.73, 118.01, 107.87, 101.76, 157.69, 127.72, 91.9, 121.96, 69.82, 67.91, 3.99, 6, 109.79, 79.9, 5.99, 53.93, 89.83, 39.92, 131.78, 105.86, 103.99, 87.99, 115.91, 15.98, 87.53, 8, 7.98, 101.81, 99.99, 129.9, 53.99, 10, 0, 77.99, 115.77]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.047, 1.051, 2.053, 2.554, 3.556, 5.057, 6.058, 7.06, 8.062, 8.563, 9.564, 11.066, 12.068, 13.069, 14.571, 15.572, 16.574, 18.075, 19.076, 20.578, 21.579, 22.588, 24.091, 25.091, 26.592, 27.592, 28.593, 30.095, 31.099, 32.599, 33.601, 34.603, 35.603, 36.104, 37.105, 38.106, 39.609, 40.609, 42.111, 42.924]
    y-axis "Memory MiB" 0 --> 500
    line [21.42, 86.91, 142.11, 147.21, 176.38, 227.01, 216.14, 210.54, 214.51, 214.4, 207.96, 272.05, 252.74, 181.34, 181.08, 187.38, 201.61, 215.7, 201.49, 177.95, 206.7, 191.19, 212.37, 251, 210.36, 221.2, 218.37, 202.99, 205.78, 203.22, 211.89, 266.48, 337.6, 252.37, 245.34, 209.24, 212.06, 209.03, 236.95, 0]
    line [19.5, 84.58, 139.77, 144.94, 174.12, 224.75, 213.81, 208.52, 212.1, 212.03, 205.57, 269.7, 250.5, 179.02, 178.77, 185.01, 199.33, 213.42, 199.22, 175.67, 204.39, 188.96, 210.12, 248.88, 208.12, 218.98, 212.57, 200.77, 203.57, 201.01, 209.69, 264.27, 335.36, 250.19, 243.16, 207.06, 209.88, 206.84, 234.77, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.051, 2.053, 2.554, 3.554, 5.055, 6.063, 7.566, 8.567, 9.568, 11.075, 11.576, 12.077, 13.078, 13.579, 14.584, 15.587, 17.089, 18.091, 19.596, 20.598, 22.099, 23.1, 24.105, 25.607, 26.611, 28.114, 29.115, 30.116, 31.617, 32.62, 34.123, 35.125, 36.627, 37.627, 38.631, 40.137, 41.137, 42.638]
    y-axis "CPU percent" 0 --> 200
    line [49.89, 95.85, 115.8, 80.02, 151.93, 136.9, 93.86, 149.99, 51.9, 94.95, 113.77, 107.78, 0, 2, 2, 2, 2, 25.89, 95.79, 103.94, 53.97, 75.89, 91.75, 103.87, 103.35, 45.95, 117.9, 105.82, 21.98, 63.89, 13.98, 45.87, 67.92, 27.98, 57.69, 139.87, 49.97, 145.99]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.052, 1.051, 2.053, 2.554, 3.554, 5.055, 6.063, 7.566, 8.567, 9.568, 11.075, 11.576, 12.077, 13.078, 13.579, 14.584, 15.587, 17.089, 18.091, 19.596, 20.598, 22.099, 23.1, 24.105, 25.607, 26.611, 28.114, 29.115, 30.116, 31.617, 32.62, 34.123, 35.125, 36.627, 37.627, 38.631, 40.137, 41.137, 42.638, 43.18]
    y-axis "Memory MiB" 0 --> 500
    line [23.69, 124.22, 151.3, 184.02, 190.25, 231.38, 249.51, 225.7, 244.53, 226.31, 261.2, 287, 258.88, 193.23, 183.93, 182.73, 182.48, 182.45, 186.05, 205.36, 199.05, 181.03, 224.16, 209.36, 241.77, 271.18, 206.41, 224.63, 220.46, 196.46, 198.55, 202.89, 198.73, 190.13, 180.04, 186.54, 215.18, 186.73, 228.61, 0]
    line [21.68, 121.91, 148.33, 181.73, 187.92, 229.06, 247.13, 223.36, 241.29, 223.93, 258.85, 284.97, 256.5, 190.85, 181.54, 180.34, 180.11, 180.08, 183.67, 202.99, 196.68, 178.65, 221.79, 206.98, 239.42, 268.82, 204.06, 222.29, 218.26, 194.11, 196.2, 200.53, 196.38, 187.78, 177.6, 184.18, 212.32, 184.39, 226.23, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 20.04 s 20.00 s -0.04 s (-0.20%)
Estimated CPU 0.47 s 0.51 s +0.04 s (+8.26%)
Peak PSS 87.03 MiB 89.30 MiB +2.28 MiB (+2.62%)
Peak RSS 89.38 MiB 91.35 MiB +1.97 MiB (+2.21%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

@ldm0
ldm0 force-pushed the layout-wpt-main branch from 9d10f1b to 86cb08a Compare August 26, 2026 22:06
@github-actions

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 179 / 240 rows; 37 / 48 sites produced rows; 11 unexpected empty sites.

✅ Deterministic fixture diagnostic is clean.

Common ancestor b1a3d2465473 → HEAD 86cb08a27dfc; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 184 / 240 179 / 240 -5 (-2.72%)
Contract fill 76.67% 74.58% -2.09 pp (-2.73%)
Sites with rows 38 / 48 37 / 48 -1 (-2.63%)
Sites meeting row contract 36 / 48 35 / 48 -1 (-2.78%)
Unexpected empty sites 10 11 +1 (+10.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 37; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 3 extracted: 35; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 3
Observed duration 34.63 s 38.32 s +3.69 s (+10.66%)
Estimated CPU 29.76 s 32.08 s +2.32 s (+7.80%)
Peak PSS 275.47 MiB 329.60 MiB +54.13 MiB (+19.65%)
Peak RSS 277.77 MiB 332.33 MiB +54.56 MiB (+19.64%)
Peak threads 27 26 -1 (-3.70%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 32 / 40 27 / 40 -5
games 37 / 40 37 / 40 0
life 25 / 40 25 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.537, 3.037, 3.538, 4.038, 5.04, 6.04, 7.041, 8.043, 9.043, 9.544, 10.544, 11.546, 12.546, 13.547, 14.548, 15.549, 16.551, 17.552, 18.553, 19.555, 20.556, 21.558, 22.559, 23.561, 24.562, 25.564, 26.565, 27.066, 28.067, 29.069, 30.07, 30.57, 31.07, 32.071, 33.072, 34.072]
    y-axis "CPU percent" 0 --> 200
    line [57.94, 105.93, 121.86, 111.89, 125.93, 145.97, 157.85, 114, 141.83, 69.93, 125.81, 145.85, 97.91, 57.83, 78.06, 27.99, 44.02, 35.96, 111.89, 115.89, 113.82, 81.89, 129.82, 125.77, 9.99, 57.83, 93.9, 23.93, 111.85, 113.94, 5.99, 113.78, 49.93, 2, 62, 18, 113.77, 50.01]
Loading
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.036, 2.537, 3.037, 3.538, 4.038, 5.04, 6.04, 7.041, 8.043, 9.043, 9.544, 10.544, 11.546, 12.546, 13.547, 14.548, 15.549, 16.551, 17.552, 18.553, 19.555, 20.556, 21.558, 22.559, 23.561, 24.562, 25.564, 26.565, 27.066, 28.067, 29.069, 30.07, 30.57, 31.07, 32.071, 33.072, 34.072, 34.633]
    y-axis "Memory MiB" 0 --> 500
    line [20.69, 118.27, 143.04, 176.44, 179.34, 190.91, 226.66, 225.96, 231.37, 236.63, 227.46, 225.9, 228.18, 206.46, 210.3, 199.33, 188.9, 177.8, 188.71, 212.06, 247.3, 277.77, 209, 240.24, 226.89, 204.45, 207.67, 202.79, 216.51, 269.34, 277.43, 228.35, 243.91, 243.16, 225.87, 234.13, 218.05, 249.53, 215.38, 0]
    line [18.54, 115.79, 140.58, 173.99, 176.89, 188.46, 224.24, 223.55, 229.41, 234.26, 225.09, 223.66, 225.49, 204.15, 207.96, 196.9, 186.51, 176.3, 186.41, 209.46, 245, 275.47, 206.69, 237.95, 224.58, 202.14, 205.41, 200.39, 214.1, 266.96, 274.72, 225.94, 241.5, 240.75, 223.5, 231.78, 215.66, 247.15, 212.99, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 3.039, 4.04, 4.54, 5.041, 5.542, 6.544, 7.545, 8.546, 9.546, 10.547, 11.047, 12.048, 13.048, 14.05, 15.05, 16.051, 17.052, 18.054, 19.556, 20.557, 21.558, 22.56, 23.562, 24.563, 25.565, 26.566, 28.068, 29.069, 30.07, 31.072, 32.074, 33.075, 34.076, 35.579, 36.58, 37.58]
    y-axis "CPU percent" 0 --> 200
    line [51.97, 113.85, 99.76, 163.79, 133.79, 129.79, 135.84, 139.57, 81.9, 101.96, 137.95, 70.01, 0, 15.98, 99.95, 99.78, 41.96, 14, 121.9, 75.82, 119.67, 133.79, 111.84, 129.76, 121.83, 107.81, 45.94, 31.97, 43.88, 25.97, 117.82, 99.76, 101.77, 11.97, 31.95, 43.92, 117.86, 124.07]
Loading
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.037, 3.039, 4.04, 4.54, 5.041, 5.542, 6.544, 7.545, 8.546, 9.546, 10.547, 11.047, 12.048, 13.048, 14.05, 15.05, 16.051, 17.052, 18.054, 19.556, 20.557, 21.558, 22.56, 23.562, 24.563, 25.565, 26.566, 28.068, 29.069, 30.07, 31.072, 32.074, 33.075, 34.076, 35.579, 36.58, 37.58, 38.324]
    y-axis "Memory MiB" 0 --> 500
    line [21.04, 121.4, 146.11, 189.07, 238.86, 257.32, 231.96, 224.07, 254.03, 218.97, 230.24, 247.07, 222.63, 215.94, 218.3, 203.42, 190.79, 181.05, 177.99, 232.52, 191.07, 217.93, 234.45, 258.6, 209.3, 217.23, 206.71, 190.02, 186.98, 191.45, 197.88, 269.16, 332.33, 239.69, 218.69, 220.7, 213.77, 200.75, 232.73, 0]
    line [18.83, 118.86, 143.58, 186.5, 236.29, 254.71, 230.26, 220.78, 251.22, 216.34, 227.62, 244.44, 220.01, 213.32, 215.68, 199.68, 187.13, 178.43, 175.38, 229.92, 188.45, 215.32, 231.83, 255.99, 206.69, 214.43, 204.07, 187.35, 184.31, 189.12, 195.21, 266.53, 329.6, 237.01, 215.95, 218.04, 211.14, 198.13, 230.1, 0]
Loading

Deterministic fixture · diagnostic

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4
Observed duration 19.91 s 19.93 s +0.01 s (+0.06%)
Estimated CPU 0.44 s 0.44 s 0.00 s (0.00%)
Peak PSS 84.72 MiB 84.18 MiB -0.55 MiB (-0.64%)
Peak RSS 87.16 MiB 86.38 MiB -0.79 MiB (-0.90%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

Spider Bench is informational: site failures, missing benchmark reports, failed browser service runs, fixture diagnostics, timing, and performance deltas do not fail the workflow. Build, runner, and artifact infrastructure errors can still fail it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant