Skip to content

th-562b6d: clamp chat max_tokens to model /model/info ceiling#190

Open
brentrager wants to merge 10 commits into
mainfrom
localflavor-hardening
Open

th-562b6d: clamp chat max_tokens to model /model/info ceiling#190
brentrager wants to merge 10 commits into
mainfrom
localflavor-hardening

th-1cc9fa: raise starvation-prone server defaults (max_tokens 512->81…

39b3015
Select commit
Loading
Failed to load commit list.

There are no checks for this commit