Skip to content

docs(modeling): add cluster-free (non-SGE) run instructions - #2

Open
cbiar wants to merge 1 commit into
mainfrom
readme-nosge
Open

docs(modeling): add cluster-free (non-SGE) run instructions#2
cbiar wants to merge 1 commit into
mainfrom
readme-nosge

Conversation

@cbiar

@cbiar cbiar commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

Makes scripts/modeling/'s README sufficient to reproduce the pipeline without an SGE cluster.

I verified the gap by taking a clean checkout of exactly what ships (code + raw data, no processed CSVs, no models) and following the README in the pinned env. Findings:

  • The submit_*.sh wrappers are ordinary bash scripts — the #$ lines are SGE directives that plain bash ignores. Confirmed bash scripts/submit_preprocess.sh runs end-to-end with no scheduler.
  • Following the old Option B literally ran without errors but produced silently incomplete results: only the full subset trained, and merge.py loaded "0 holdout evaluations" (so combined_df's holdout columns were empty).
  • The step-1 comment claimed processed CSVs were "already provided" — stale, since they're regenerated by preprocess.py.

Change (docs only, one file)

Rewrites the "without a cluster" section into:

  • B1 (recommended): run the wrappers with bash scripts/submit_*.sh for full published-run coverage (all subsets, every best model).
  • B2: granular per-stage python calls, now with the explicit per-subset input to output mapping and a note that every best model must be evaluated to populate combined_df.
  • Corrects the "already provided" claim.

No code or data changes.

🤖 Generated with Claude Code

The submit_*.sh wrappers are plain bash scripts (the #$ lines are ignored
by bash), so a non-SGE user can run `bash scripts/submit_*.sh` for full
reproduction (Option B1). Adds a granular per-stage python alternative
(B2) with the explicit per-subset input->output mapping and a note that
every best model must be evaluated to populate combined_df's holdout
columns. Corrects the stale "processed CSVs already provided" claim.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant