Skip to content

feat: add mtplx engine support - #161

Merged
outofcoffee merged 3 commits into
mainfrom
mtplx
Sep 4, 2026
Merged

feat: add mtplx engine support#161
outofcoffee merged 3 commits into
mainfrom
mtplx

Conversation

@outofcoffee

@outofcoffee outofcoffee commented Sep 3, 2026

Copy link
Copy Markdown
Collaborator

Proposes the OpenSpec change that adds mtplx as a servable, daemon-supervised, fleet-wakeable engine.

Summary

  • mtplx becomes a servable engine: mtplx serve with the model as --model, the served name as --model-id, the context window as --context-window, and --download always passed so the engine fetches a missing model itself
  • PARALLEL n renders as --max-active-requests n, MTPLX's admission cap; the scheduling mode stays a preset concern
  • The fleet can wake a node for mtplx: the Spinloop-to-deploy-config derivation becomes runner-aware (a node-side runner gate, per-engine preset fallback keys, owned preset keys)
  • Readiness via MTPLX's /health; the catalogue gains an mtplx provider; docs and examples/mtplx/

Implementation details

  • Cloud deploy is a non-goal: MTPLX is Apple-Silicon-only with no machine image, so remote deploy keeps refusing it and the cloud gate stays llamacpp/vllm.
  • Moving the local model-path check to the cloud-only path is a behaviour change beyond mtplx: llamacpp and vllm node wakes with local model files are refused today ("cannot deploy the local model file") and would start working. It is spec'd in the fleet-routing delta.
  • No metrics dialect: MTPLX's /metrics is a JSON ring of per-request envelopes, not Prometheus counters, so it gets the omlx treatment — no scrape, no token stats.
  • omlx fleet wake is tracked separately (feat: add fleet wake for omlx #159); the runner-aware path makes it a small follow-up.

Refs #148

@outofcoffee outofcoffee added the enhancement New feature or request label Sep 3, 2026
MTPLX is Apple-Silicon only, so it is servable and fleet-wakeable but
not a cloud deploy target. It has no metrics dialect; readiness is
still checked, against the base address with no scrape target.
@outofcoffee
outofcoffee merged commit c0622b9 into main Sep 4, 2026
2 checks passed
@outofcoffee
outofcoffee deleted the mtplx branch September 4, 2026 00:02
@outofcoffee outofcoffee changed the title docs(openspec): propose the mtplx engine change feat: add mtplx engine support Sep 4, 2026
@outofcoffee outofcoffee linked an issue Sep 4, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: add mtplx support

1 participant