Skip to content

[Feature Request] Choose the right local model based on available resources on the local system #23

Description

@GSSwain

1. Type of Issue

Please select the type of issue (mark with an [x]):

  • Feature Request
  • Performance Improvement
  • Documentation / Task / Other

2. Why is it required?

Describe the problem you are facing, why this change is necessary, or what context/background makes this important.

If the system running maca, has more memory we can run more powerful local models like Gemma3 or Gemma4 (which can handle more complex tasks on local itself part of another feature). If the system has less memory, we continue to use Gemma2


3. What is the acceptance criteria?

Define the clear, concrete criteria that must be met for this issue to be considered resolved (e.g., specific test cases passing, UI behavior, CLI parameters support, etc.).

  1. Runs the appropriate model with supported parameters based on the local system resources.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions