I've been looking through the project and noticed that the model configuration could use a bit more explanation. Since Atomic Agent is built around local inference, users will likely try different GGUF models, quantizations, and context sizes.
It would be helpful to include recommendations for:
- Supported model families
- Recommended quantizations for different hardware
- Memory/VRAM expectations
- Common configuration pitfalls
I think this would reduce setup friction, especially for people who are new to running local LLMs.
I've been looking through the project and noticed that the model configuration could use a bit more explanation. Since Atomic Agent is built around local inference, users will likely try different GGUF models, quantizations, and context sizes.
It would be helpful to include recommendations for:
I think this would reduce setup friction, especially for people who are new to running local LLMs.