Skip to content

Tasks 121/123: SPIRE coarse-routing recall DOE + multi-instance closeout (no-promote) #39

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kreneskyp merged 173 commits into from
Jul 1, 2026
Merged

Tasks 121/123: SPIRE coarse-routing recall DOE + multi-instance closeout (no-promote) #39

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
173 commits
Select commit Hold shift + click to select a range
9ade66f
Add SPIRE funnel stage diagnostics
Jun 21, 2026
c31b23d
Request review for task 120 funnel diagnostics
Jun 21, 2026
b3057a4
Add SPIRE stage containment output
Jun 21, 2026
42a7056
Request review for task 120 stage containment
Jun 21, 2026
f4456d6
Add reviewer feedback for task 120 funnel diagnostics
Jun 21, 2026
5fd1341
Add reviewer feedback for task 120 stage containment
Jun 21, 2026
ad99a4d
Add SPIRE target candidate rank diagnostics
Jun 21, 2026
c1a13f1
Request review for task 120 target candidate rank
Jun 21, 2026
2fd07be
Update SPIRE stage containment help text
Jun 21, 2026
2a2e196
Request review for task 120 stage containment help
Jun 21, 2026
9178f4b
Add SPIRE target candidate rank output
Jun 21, 2026
834b7a4
Request review for task 120 target candidate rank output
Jun 21, 2026
c3e2cc4
Add reviewer feedback for task 120 packets 003-005
Jun 21, 2026
8225571
Rewrite SPIRE suite artifact templates
Jun 21, 2026
39ed9e1
Add review packet for SPIRE suite artifact templates
Jun 21, 2026
e33ac2a
Add reviewer feedback for task 120 suite artifact templates
Jun 21, 2026
46bb8b1
Add Task 120 phase 1 containment packet
Jun 21, 2026
f919874
Add reviewer feedback for task 120 phase 1 containment
Jun 21, 2026
e1f7753
Add Task 120 phase 2 block-pruning packet
Jun 21, 2026
3b743e3
Add reviewer feedback for task 120 phase 2 block-pruning
Jun 21, 2026
4617b0f
Fix flat spire target attribution
Jun 21, 2026
89269e9
Add Task 120 phase 1 attribution rerun packet
Jun 21, 2026
1f4c06a
Prune Task 120 phase 2 raw pipeline artifacts
Jun 21, 2026
c7c3f66
Add reviewer feedback for task 120 phase 1 attribution rerun
Jun 21, 2026
73cfe3e
Prune Task 120 phase 1 raw pipeline artifacts
Jun 21, 2026
c304158
Add Task 120 phase 3 budget-policy packet
Jun 21, 2026
7f15698
Add reviewer feedback for task 120 phase 3 budget-policy
Jun 21, 2026
1a19160
Add Task 120 phase 4 route-overfetch packet
Jun 21, 2026
27f9316
Allow SPIRE AWS representative packets outside task 30
Jun 21, 2026
448a695
Add Task 120 AWS representative path-guard packet
Jun 21, 2026
7e86b62
Expose SPIRE production read profile counters
Jun 21, 2026
4bc4d61
Add Task 120 production read counter packet
Jun 21, 2026
7704001
Add reviewer feedback for task 120 AWS path guard
Jun 21, 2026
f1c1afc
Add reviewer feedback for task 120 packets 011-012
Jun 21, 2026
1e5f5d6
Allow SPIRE AWS representative suite overrides
Jun 21, 2026
a9149f3
Add reviewer feedback for task 120 production read counters
Jun 21, 2026
efaad19
Add Task 120 AWS suite override packet
Jun 21, 2026
200291b
Add reviewer feedback for task 120 AWS suite override
Jun 21, 2026
b033cc2
Harden SPIRE AWS representative load resume
Jun 22, 2026
393688c
Harden SPIRE AWS representative resume paths
Jun 22, 2026
234f355
Add Task 120 Phase 5 AWS evidence packet
Jun 22, 2026
a0eb16d
Add reviewer feedback for task 120 phase 5 AWS distributed
Jun 22, 2026
6f0d41b
Add Task 120 Phase 6 invariants packet
Jun 22, 2026
633c157
Require local multi-node gate before Task 120 AWS
Jun 22, 2026
bb48fff
Clarify Task 120 local multi-node gate
Jun 22, 2026
c5448e0
Support Task 120 local multi-node bench gate
Jun 22, 2026
c2daca0
Add Task 120 local multi-node gate packet
Jun 22, 2026
f1f3464
Add Task 120 final recommendation packet
Jun 22, 2026
1de7d9c
Update Task 120 status to final recommendation
Jun 22, 2026
0e4e541
Add reviewer feedback for task 120 packets 016-018
Jun 22, 2026
2788524
Add Task 121 plan + Stage-1 routing screen config (draft)
Jun 22, 2026
e3883dc
Add Task 121 local multinode suite lane
Jun 22, 2026
dd7411d
Add Task 121 Phase 0 local multinode packet
Jun 22, 2026
fedf1db
Scope Task 121 storage format to rabitq + TurboQuant (drop PQ)
Jun 22, 2026
98dff6b
Add Task 121 bounded local baseline evidence
Jun 22, 2026
64d7d1f
Flush SPIRE pipeline JSONL outputs incrementally
Jun 22, 2026
ab80fdc
Add Task 121 incremental pipeline output packet
Jun 22, 2026
006b26c
Add Task 121 q200 baseline evidence
Jun 22, 2026
cb45540
Add Task 121 tgsl200 OFAT evidence
Jun 22, 2026
37653bb
Add Task 121 bound1 OFAT evidence
Jun 22, 2026
371b9d9
Add reviewer feedback for task 121 packets 002-003
Jun 23, 2026
ccd8ccf
Add interim reviewer feedback for task 121 stage-1 routing screen
Jun 23, 2026
f63bb98
Add Task 121 bound2 OFAT evidence
Jun 23, 2026
2fe6428
Add Task 121 tgsl200 high-nprobe evidence
Jun 23, 2026
2e21da6
Add interim feedback #2 for task 121 stage-1 routing screen
Jun 23, 2026
baae3eb
Add Task 121 bound4 OFAT evidence
Jun 23, 2026
070f7d3
Add Task 121 nlist316 OFAT evidence
Jun 23, 2026
283a6f7
Add Task 121 nlist512 OFAT evidence
Jun 23, 2026
3535019
Add Task 121 nlist1024 OFAT evidence
Jun 23, 2026
b4fe33b
Add Task 121 fanout16 OFAT evidence
Jun 23, 2026
82107fe
Add Task 121 fanout32 OFAT evidence
Jun 23, 2026
e841d29
Add Task 121 degree48 OFAT evidence
Jun 23, 2026
67523f3
Add Task 121 degree64 OFAT evidence
Jun 23, 2026
f8169d7
Add Task 121 train50k OFAT evidence
Jun 23, 2026
1e8e6c5
Add Task 121 train100k OFAT evidence
Jun 23, 2026
5926b01
Add Task 121 TurboQuant format evidence
Jun 23, 2026
af885a3
Fix Task 121 local multinode suite matrix controls
Jun 23, 2026
8157187
Add Task 121 Phase 0 feedback fix packet
Jun 23, 2026
8119439
Add Task 121 Stage 1 replan packet
Jun 23, 2026
69a644d
Replace Task 121 local multinode harness wrapper
Jun 23, 2026
bc80415
Add Task 121 native local multinode evidence
Jun 23, 2026
6f6c803
Add Task 121 Phase 2 local factorial dry-run
Jun 23, 2026
8f97865
Add Task 121 Phase 2 local 10k dry-run slice
Jun 23, 2026
cb8c712
Add Task 121 Phase 2 local 50k and 100k dry-run slices
Jun 23, 2026
1575877
Add reviewer feedback for task 121 packets 004-009
Jun 23, 2026
507c781
Add Task 121 Phase 2 axis-fix prep
Jun 23, 2026
ec3feb6
Add Task 121 local 10k axis evidence
Jun 23, 2026
b43b9ab
Add reviewer feedback for task 121 packets 010-011
Jun 23, 2026
dcd68e8
Add Task 121 partial 50k b0 baseline checkpoint
Jun 23, 2026
daf5fcd
Add Task 121 local 50k f8 boundary training run
Jun 23, 2026
96c751d
Add reviewer feedback for task 121 packets 012-013 (50k Phase 2)
Jun 23, 2026
0d6ab55
Add Task 121 local 100k f8 baseline checkpoint
Jun 24, 2026
2391ec4
Add Task 121 local 100k clean latency checkpoint
Jun 24, 2026
eeabe99
Add reviewer feedback for task 121 packets 014-015 (100k)
Jun 24, 2026
14a44f0
Add Task 121 local 50k b2 checkpoint
Jun 24, 2026
b22241b
Add Task 121 local 50k b4 tr10 checkpoint
Jun 24, 2026
38c0433
Add Task 121 local 50k b4 tr50 evidence
Jun 24, 2026
62225a0
Add reviewer feedback for task 121 packet 016 (50k b2/b4)
Jun 24, 2026
0ac0e3d
Add reviewer feedback for task 121 packet 017 (100k axis-fix, interim)
Jun 24, 2026
4ffd985
Add reviewer feedback addendum for task 121 packet 017 (100k boundary…
Jun 25, 2026
4df9222
Add task 121 100k axis-fix packet
Jun 25, 2026
dfe408f
Add reviewer feedback for task 121 packet 017 submitted (100k matrix)
Jun 25, 2026
f0fb7df
Add task 121 b8 latency follow-up packet
Jun 25, 2026
5489368
Add task 121 phase3 sampled pruning pilot
Jun 25, 2026
371ab43
Add task 121 phase3 50k pruning recall packet
Jun 25, 2026
4165414
Add task 121 phase3 50k pruning retune packet
Jun 25, 2026
95eda7e
Add task 121 phase3 50k retuned pruning latency packet
Jun 25, 2026
f130a3d
Add reviewer feedback for task 121 packets 018 (b8 closeout) and 019-…
Jun 25, 2026
b21e68e
Add task 121 phase3 100k pruning retune packet
Jun 25, 2026
83dd3b1
Add reviewer feedback for task 121 packet 023 (100k pruning retune gate)
Jun 26, 2026
c3947d3
Add task 121 phase3 100k retuned latency packet
Jun 26, 2026
10d62da
Add task 121 turboquant block summary decision
Jun 26, 2026
538346e
Add task 121 final pareto verdict
Jun 26, 2026
413d96d
Add reviewer closeout sign-off for task 121 packet 026 (final verdict)
Jun 26, 2026
700f5de
Add Task 123: SPIRE route precision vs scan cost (Task 121 follow-up)
Jun 27, 2026
5dfa939
Add task 123 phase A gate evidence
Jun 27, 2026
b8cdee7
Update task 123 phase A gate status
Jun 27, 2026
b99e56d
Add task 123 status sync review packet
Jun 27, 2026
e17e61c
Add task 123 final closeout request
Jun 27, 2026
4920c47
Add reviewer feedback for task 123 closeout: request Phase B spot-che…
Jun 27, 2026
a09cf0f
Add task 123 phase B spot-check packet
Jun 27, 2026
7c8f373
Update task 123 spot-check status
Jun 27, 2026
7b22344
Add task 123 spot-check status sync packet
Jun 27, 2026
348c0d8
Add task 123 n1024 b2 follow-up packet
Jun 27, 2026
dc7b630
Update task 123 b2 follow-up status
Jun 27, 2026
f57e93f
Add task 123 b2 status sync packet
Jun 27, 2026
33d641b
Update task 121 closeout status
Jun 27, 2026
bec2cd9
Add task 121 closeout status sync packet
Jun 27, 2026
a3148af
Mark task 123 complete
Jun 27, 2026
d2daff6
Add task 123 completion record
Jun 27, 2026
86d918d
Add reviewer sign-off for task 123 closeout (Phase B spot-check confi…
Jun 27, 2026
0e0347f
Address task 123 completion review feedback
Jun 27, 2026
a9b0748
Confirm task 123 completion feedback incorporated (close)
Jun 27, 2026
ee68102
Add reviewer feedback: task 123 cost verdict is single-instance; re-m…
Jun 27, 2026
fe57bb5
Reopen tasks 121/123: multi-instance substrate + dual latency/recall …
Jun 27, 2026
7f870c7
Add task 123 multi-instance baseline packet
Jun 27, 2026
a91955a
Expose production read per-node payload timeline
Jun 27, 2026
3902463
Add task 123 production read timeline packet
Jun 27, 2026
7cd8b31
Add reviewer feedback for task 123 packets 009 (multi-instance baseli…
Jun 27, 2026
702d93e
Add coordination feedback: fold PR #43 pre_materialization_prune into…
Jun 27, 2026
c05fd9a
Pre-commit note: task 123 packet 011 still id-only projection + 32q; …
Jun 28, 2026
641c853
Add local multinode projection-column suite option
Jun 28, 2026
887c91a
Add task 123 multi-instance 200q evidence packet
Jun 28, 2026
6a01c90
Merge remote-tracking branch 'origin/task-121-spire-coarse-routing-re…
Jun 28, 2026
62c0dfc
Document revised task 121 123 core-algorithm closeout
Jun 28, 2026
dbaad3a
Merge origin/main into task 121 branch
Jun 28, 2026
946a52c
Decline task 123 core-algorithm closeout: 200q retracts 32q win; late…
Jun 28, 2026
6a7e025
Respond to task 123 closeout decline
Jun 28, 2026
8a81c15
Accept task 123 decline-response; retract my latency-trace finding (k…
Jun 28, 2026
a5d03ab
Skip doomed SPIRE candidate materialization
Jun 27, 2026
ea036b5
Prune SPIRE batched TQ materialization
Jun 27, 2026
8bdbf7b
Gate SPIRE pre-materialization prune
Jun 27, 2026
692ea78
Request review for task 123 prune rehome
Jun 28, 2026
a977981
Thread local multinode bench session GUCs
Jun 28, 2026
4f6804e
Request review for local multinode bench GUCs
Jun 28, 2026
cb13045
Add local multinode production-read variants
Jun 28, 2026
7896f77
Request review for production-read bench variants
Jun 28, 2026
95fb472
Review 014/015/016: prune is inert for boundary>0 candidates; fix eng…
Jun 28, 2026
5d9486b
Pre-position review for task 123 packet 017: prune arm no-op, transpo…
Jun 29, 2026
54d9ca7
Request review for multinode prune A/B
Jun 29, 2026
28a7ba5
Merge remote-tracking branch 'origin/task-121-spire-coarse-routing-re…
Jun 29, 2026
44424a2
Clarify packet 017 communications verdict
Jun 29, 2026
d2ffbda
Enable SPIRE prune threshold for dedupe
Jun 29, 2026
e5ec01c
Request review for dedupe prune threshold
Jun 29, 2026
fc3bb1e
Review task 123 018 (dedupe prune LGTM, recall A/B required) + accept…
Jun 29, 2026
bcd2f0d
Request review for dedupe prune multinode A/B
Jun 30, 2026
6c5b416
Merge remote-tracking branch 'origin/task-121-spire-coarse-routing-re…
Jun 30, 2026
af97f5f
Request review for task 123 post-A/B closeout
Jun 30, 2026
f68967a
Repair task 123 packet 019 metadata
Jun 30, 2026
183f76a
Review task 123 packet 020: accept no-promote closeout, require prune…
Jun 30, 2026
d46b749
Close tasks 121/123: multi-instance no-promote closeout, prune defaul…
Jul 1, 2026
d2e1abc
Confirm task 123 packet 021 status-sync: LGTM to merge
Jul 1, 2026
10f8736
Merge remote-tracking branch 'origin/main' into task-121-spire-coarse…
Jul 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
9 changes: 9 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,3 +59,12 @@ reviews/**/truth-cache/
benchmarks/**/truth-cache/
reviews/**/truth-*.json
benchmarks/**/truth-*.json

# Raw per-query SPIRE pipeline diagnostics are large and usually regenerable.
# Commit compact summaries and suite-results.jsonl unless a packet explicitly
# needs a force-added raw diagnostic artifact.
reviews/**/pipeline-*-funnel.jsonl
reviews/**/pipeline-*-stage-containment.jsonl
reviews/**/pipeline-*-leaf-block-rank.jsonl
reviews/**/pipeline-*-target-block-rank.jsonl
reviews/**/pipeline-*-target-candidate-rank.jsonl
1,493 changes: 1,468 additions & 25 deletions crates/ecaz-cli/src/commands/bench/spire_pipeline.rs
View file
Open in desktop

Large diffs are not rendered by default.

670 changes: 670 additions & 0 deletions crates/ecaz-cli/src/commands/bench/suite.rs
View file
Open in desktop

Large diffs are not rendered by default.

Loading