Skip to content

Default to llama.cpp backend instead of platform default - #34

Merged
mmonteleone merged 1 commit into
mainfrom
mlx-opt-in
Jun 16, 2026
Merged

Default to llama.cpp backend instead of platform default#34
mmonteleone merged 1 commit into
mainfrom
mlx-opt-in

Conversation

@mmonteleone

Copy link
Copy Markdown
Owner

This PR changes the default behavior of corral search. Instead of defaulting to a platform-specific backend (MLX on Apple Silicon, llama.cpp elsewhere), it now consistently defaults to llama.cpp (GGUF).

  • Provides more predictable search results across different platforms.
  • Eliminates warnings when using the --quants flag on macOS Apple Silicon.
  • README.md: Updated documentation to reflect that corral search now defaults to llama.cpp/GGUF results.
  • src/lib/corral-helpers.sh: Changed platform_default_backend to return llama.cpp as the default backend globally.
  • src/lib/corral-runtime.sh: Updated backend inference logic to fall back to llama.cpp by default.
  • src/lib/corral-search.sh: Modified cmd_search to explicitly use llama.cpp when no --backend flag is provided.
  • tests/: Updated smoke and unit tests to verify the new default search behavior and ensure no warnings are issued on Apple Silicon.

If/when MLX-LM returns from hibernation, may revisit defaulting to MLX.

@mmonteleone
mmonteleone merged commit 0a01978 into main Jun 16, 2026
10 checks passed
@mmonteleone
mmonteleone deleted the mlx-opt-in branch June 16, 2026 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant