Update config-ai-ec4c0559.ini#1353
Conversation
This integrates the GWDG SAIA API as a built-in AI provider in QualCoder. Since SAIA is fully OpenAI-compatible, it integrates into the existing AI settings. As this modifies config.ini, I want to ask if this update does overwrite or delete custom models that users may have already added to their local configurations. I have successfully tested this integration and confirmed it works.
|
You have modified some random test file. This will have no effect on the actual application. The configs for the default models are in ai_llm.py, in get_default_ai_models(). A few other issues:
|
Oops, sorry about the test file! I'll move everything over to ai_llm.py.
I thought the "alias" naming worked the same way as Blablador, but I can switch those to maybe gemma4 and qwen3.6? Or what is the best practice?
This is for the Gemma 4 model. Qwen 3.6 has an even bigger context length window. However, I'm also not sure what to put here because it's different for different models.
Ok, thank you |
|
Please test the actual code that you are suggesting thoroughly on your local machine before creating a pull request. Do not assume that something is working, verify it. Also, try to break the code by doing silly things as normal user would do as well. Regarding this particular service: Please do some research first as suggested in the issue thread. If we decide to include this into the default options, it would be up to you to select a suitable model for the "large-model" and "fast-model" variants. In most cases, QualCoder uses the "large-model" only. Choose one that can also interpret subtle details in the text and is able to handle complex prompts. The fast variant can be a small model. It is only used for simple housekeeping tasks, like auto-naming an AI chat (an upcoming feature, not yet implemented in the main branch). |
This integrates the GWDG SAIA API as a built-in AI provider in QualCoder. Since SAIA is fully OpenAI-compatible, it integrates into the existing AI settings. As this modifies config.ini, I want to ask if this update does overwrite or delete custom models that users may have already added to their local configurations. I have successfully tested this integration and confirmed it works.