Skip to content

P5: New-release detection + back-to-back N runs to seed a fresh baseline #167

Description

@FumingPower3925

Part of #151.

Goal. When a new celeris release lands, the next weekly benchmark runs the suite 3–5× back-to-back to establish a solid baseline immediately (instead of waiting weeks for per-week samples).

Detection (the poll workflow was deleted, so no cron poller).

  • Read the current celeris pin from go.mod via celerisVersion() (mage_helpers.go:196).
  • Compare against a persisted 'last-benchmarked version' marker (the results/ dir is ephemeral in CI). Recommend: derive the newest benchmarked version from docs index.json (single source of truth, no extra state). Alternatives: orphan state branch (old poller pattern) or a GH variable.
  • If go.mod pin != newest benchmarked version → 'new release since last benchmark'.

Back-to-back N.

Acceptance. Releasing celeris vX → the next weekly bench runs N× and publishes N runs under that version's date; subsequent weeks run 1×.

Refs: mage_helpers.go:196, deleted poll-celeris-release.yml (git history), docs index.json, mage_bench.go (BENCH_RUNS).

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions