Custom Provider for Email summary not respected

[gdkrmr]

The problem

• I installed 4.1.0 from the Github release.
• I am using LMStudio as the default provider (localhost:1234)
• When setting a different provider (FLM) on localhost:52625 for email summaries, ThunderAI still uses the default provider for summaries

Some observations:

• The first time I tried, I got an API error in Thunderbird but nothing showed up in the logs of the server. Now the custom provider is simply ignored.
• Reading out the model list from the custom provider works, so communication between ThunderAI and the provider works.
• Setting FLM as the default provider also works. Setting LMStudio as the custom provider for summaries is also ignored.

Which Operative System are you using?

Linux

Which version of Thunderbird are you using?

151

Which version of ThunderAI has the issue?

4.1.0

Which integration are you using?

OpenAI Compatible API

Anything in the Thunderbird console logs that might be useful?

Additional information

No response

[micz]

May you activate the debug option in the addon preferences and post here the log from the Thunderbird console?
Thank you.

[gdkrmr]

Here you go. It is currently set to use flm on http://localhost:52625 with qwen3.5:9b for everything and lmstudio on http://localhost:1234 with qwen3.6-35b-a3b-mtp for the summaries. When doing the summary it simply uses the flm endpoint and ignores the extra option

log

``` [ThunderAI Logger | mzta-summarystore] [removeSummary] data_id: 0100019e9bac123d-048fd591-bb6a-4909-9ff2-9fe866699a81-000000@email.amazonses.com [mzta-logger.js:35:44](moz-extension://53bd75da-6a02-491a-8f4e-e8d1e98a9b66/js/mzta-logger.js) [ThunderAI Logger | model-worker-openai_comp] line: "{\"id\":\"chatcmpl-bad65e80ea2e4a4029aca246\",\"object\":\"chat.completion.chunk\",\"created\":1780987376,\"model\":\"qwen3.5:9b\",\"choices\":[{\"index\":0,\"delta\":{\"role\":\"assistant\",\"content\":\" show\"},\"finish_reason\":null}]}" [mzta-logger.js:35:44](moz-extension://53bd75da-6a02-491a-8f4e-e8d1e98a9b66/js/mzta-logger.js) [ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"`."},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"`."},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"Action"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"Action"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" Items"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" Items"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":":**"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":":**"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"\n"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"\n"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"*"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"*"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" "},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" "},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" *"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" *"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"None"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"None"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" specified"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" specified"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" this"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" this"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" thread"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" thread"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":".*"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":".*"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" The"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" The"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" email"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" email"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" serves"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" serves"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" as"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" as"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" an"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" an"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" informational"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" informational"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" update"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" update"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" for"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" for"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" existing"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" existing"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" users"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" users"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" upgrade"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" upgrade"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" or"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" or"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" learn"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" learn"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" new"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" new"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" usage"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" usage"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" patterns"},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":" patterns"},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] buffer: data: {"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","system_fingerprint":"fp_438cdb9898b76135","choices":[{"index":0,"delta":{"content":null},"finish_reason":"stop"}],"usage":{"prompt_tokens":805,"completion_tokens":263,"total_tokens":1068,"active_kv_tokens":1068,"max_kv_token_capacity":65536,"kv_token_occupancy_rate_percentage":1.629638671875,"load_duration":8.92e-07,"prefill_duration_ttft":3.189787904,"decoding_duration":33.751152,"prefill_speed_tps":252.36787655709912,"decoding_speed_tps":7.792326614510817}}

data: [DONE]

mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] line: "{"id":"chatcmpl-bad65e80ea2e4a4029aca246","object":"chat.completion.chunk","created":1780987376,"model":"qwen3.5:9b","system_fingerprint":"fp_438cdb9898b76135","choices":[{"index":0,"delta":{"content":null},"finish_reason":"stop"}],"usage":{"prompt_tokens":805,"completion_tokens":263,"total_tokens":1068,"active_kv_tokens":1068,"max_kv_token_capacity":65536,"kv_token_occupancy_rate_percentage":1.629638671875,"load_duration":8.92e-07,"prefill_duration_ttft":3.189787904,"decoding_duration":33.751152,"prefill_speed_tps":252.36787655709912,"decoding_speed_tps":7.792326614510817}}" mzta-logger.js:35:44
[ThunderAI Logger | model-worker-openai_comp] AI full response: Subject: Ollama 0.30 Release: Enhanced Performance and GGUF Support

Topic: Announcement of Ollama version 0.30, featuring improved performance via llama.cpp integration and expanded hardware/model compatibility.

Key Updates & Decisions:

• Performance Boosts: Up to 20% faster throughput on NVIDIA GPUs (verified with Gemma 4 26B on RTX 5090). Vulkan is now enabled by default, extending GPU acceleration to AMD and Intel devices without additional library installation.
• Expanded Model Support: Added support for the GGUF ecosystem, including LFM, Prism families, and Unsloth fine-tuned models. Users can run GGUF files directly from Hugging Face using a Modelfile with the FROM command (e.g., ollama create -f Modelfile my-model).
• Agent Integration: Models supporting tool calling are now compatible with coding agents like Claude Code, Hermes Agent, and OpenClaw via specific launch commands. Tool capabilities can be verified using ollama show.

Action Items:

• None specified in this thread. The email serves as an informational update for existing users to upgrade or learn new usage patterns. mzta-logger.js:35:44
  [ThunderAI Logger | mzta_specialCommand] tokensDone: Subject: Ollama 0.30 Release: Enhanced Performance and GGUF Support

Topic: Announcement of Ollama version 0.30, featuring improved performance via llama.cpp integration and expanded hardware/model compatibility.

Key Updates & Decisions:

• Performance Boosts: Up to 20% faster throughput on NVIDIA GPUs (verified with Gemma 4 26B on RTX 5090). Vulkan is now enabled by default, extending GPU acceleration to AMD and Intel devices without additional library installation.
• Expanded Model Support: Added support for the GGUF ecosystem, including LFM, Prism families, and Unsloth fine-tuned models. Users can run GGUF files directly from Hugging Face using a Modelfile with the FROM command (e.g., ollama create -f Modelfile my-model).
• Agent Integration: Models supporting tool calling are now compatible with coding agents like Claude Code, Hermes Agent, and OpenClaw via specific launch commands. Tool capabilities can be verified using ollama show.

Action Items:

• None specified in this thread. The email serves as an informational update for existing users to upgrade or learn new usage patterns. mzta-logger.js:35:44
  [ThunderAI Logger | mzta-summarystore] [saveSummary] data_id: 0100019e9bac123d-048fd591-bb6a-4909-9ff2-9fe866699a81-000000@email.amazonses.com mzta-logger.js:35:44
  [ThunderAI Logger | mzta-storage] [writeSummary] messageId: 0100019e9bac123d-048fd591-bb6a-4909-9ff2-9fe866699a81-000000@email.amazonses.com, force: true mzta-logger.js:35:44
  [ThunderAI Logger | mzta-storage] [getRecord] messageId: 0100019e9bac123d-048fd591-bb6a-4909-9ff2-9fe866699a81-000000@email.amazonses.com mzta-logger.js:35:44
  [ThunderAI Logger | mzta-storage] [getRecord] record found: false mzta-logger.js:35:44
  [ThunderAI Logger | mzta-background] [stopWorking] WorkingLevel: 0

</details>

[HerShin5]

The debug log seems pretty conclusive that the summary path is reusing the default OpenAI-compatible provider (flm / qwen3.5:9b) even though discovery for the summary provider works.

I'd probably test this as a routing-resolution bug rather than a model-worker streaming bug:

• summary command resolves (provider_id, base_url, model) from its own override before falling back to defaults
• the final request envelope/target is captured in debug as redacted metadata: provider name, host/path, model, key-present, but not the key
• provider discovery and generation use the same provider object; otherwise /models can succeed against provider B while /chat/completions still goes to provider A
• add a regression with two local OpenAI-compatible servers on different ports and assert the summary request hits the override port

That pattern also catches the remote-gateway case, where the default may be local LM Studio but one workflow should intentionally go through a separate OpenAI-compatible endpoint.

Disclosure: I'm associated with/evaluating KiroForge (https://kiroforge.cloud/v1), an OpenAI-compatible gateway. This class of bug is exactly why I like logging the resolved provider/endpoint separately from the streamed chunks: otherwise endpoint mix-ups look like model quality issues instead of routing issues.

[micz]

Thank you for the info.
Give me some days to check it.

[micz]

I should have fixed the bug.
Could you test it?

Please follow this steps:

1. Download the file thunderai-v4.1.1_issue804.zip
2. Rename it from *.zip to *.xpi
3. Backup your custom prompts and custom data placeholders if you have any
4. Install this version

Let me know, thanks!

[gdkrmr]

your patch fixed it for me, thanks!

[micz]

Great, thank you for your feedback!