Skip to content
Discussion options

You must be logged in to vote

You can download GGUF model quantizations on HuggingFace, or download them in settings. That said, I don't recommend Gemma 3 or Gemma 4 models. In my benchmarks, Qwen3.5 performs better at each size.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@1dotblack
Comment options

Answer selected by johnbean393
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants