Skip to content

chore: update model catalog from bot issues - #1070

Merged
Erin McNulty (erin2722) merged 3 commits into
mainfrom
chore/autofix-bot-issues-2026-08-07
Aug 7, 2026
Merged

chore: update model catalog from bot issues#1070
Erin McNulty (erin2722) merged 3 commits into
mainfrom
chore/autofix-bot-issues-2026-08-07

Conversation

@github-actions

@github-actions github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Automated daily batch of model catalog updates from bot issues.

Included issues

Summary

Issue Provider Primary model Changed models Added models Updated models Verification sources
#1068 together thinkingmachines/inkling thinkingmachines/inkling None thinkingmachines/inkling 1
2
#1069 perplexity perplexity/kimi-k3 perplexity/kimi-k3
perplexity/glm-5.2
perplexity/kimi-k3
perplexity/glm-5.2
None 1
2

Verified metadata

#1068: [BOT ISSUE] Together: add together to thinkingmachines/inkling available_providers (regression)

Model Display name Parent Providers Format Flavor Token limits Pricing Lifecycle
thinkingmachines/inkling Inkling baseten, openrouter, together openai chat input=1048576, output=not provided in/out=1/4.05 per 1M; cache read=0.17 per 1M multimodal=true; reasoning=true

Verification notes

No LLM verification step ran; model metadata was already complete in the issue.

sync_models vs proposed update

sync_models cross-check found differences. Official provider verification was used for the applied values, and sync_models discrepancies are listed below for review.

Model Field Proposed update sync_models sync_models source models
thinkingmachines/inkling catalog entry present missing None

#1069: [BOT ISSUE] Perplexity: add missing perplexity/kimi-k3 and perplexity/glm-5.2 Gateway models

Model Display name Parent Providers Format Flavor Token limits Pricing Lifecycle
perplexity/kimi-k3 Perplexity: Kimi K3 perplexity openai chat input=1048576, output=not provided in/out=3/15 per 1M; cache read=0.3 per 1M multimodal=true; reasoning=true
perplexity/glm-5.2 Perplexity: GLM 5.2 perplexity openai chat input=262144, output=128000 in/out=1.4/4.4 per 1M; cache read=0.26 per 1M reasoning=true

Verification notes

No LLM verification step ran; model metadata was already complete in the issue.

sync_models vs proposed update

sync_models cross-check found differences. Official provider verification was used for the applied values, and sync_models discrepancies are listed below for review.

Model Field Proposed update sync_models sync_models source models
perplexity/kimi-k3 catalog entry present missing None
perplexity/glm-5.2 catalog entry present missing None

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

Codex (@codex) review

@vercel

vercel Bot commented Aug 7, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-proxy Ready Ready Preview Aug 7, 2026 2:40pm

Request Review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bab6228748

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment thread packages/proxy/schema/index.ts Outdated
Comment on lines +1353 to +1354
"perplexity/kimi-k3": ["perplexity"],
"perplexity/glm-5.2": ["perplexity"],

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Route gateway Perplexity models to the gateway base URL

These new perplexity/... model IDs are Perplexity Gateway Chat Completions models, whose docs call https://api.perplexity.ai/router/v1/chat/completions (see https://docs.perplexity.ai/docs/gateway/quickstart). In this proxy, a perplexity endpoint still uses EndpointProviderToBaseURL.perplexity = "https://api.perplexity.ai" and fetchOpenAI appends the normal /chat/completions path, so requests for either newly added model will be sent to https://api.perplexity.ai/chat/completions instead of the gateway route and will fail or hit the wrong API. Add a gateway-specific provider/base URL override before advertising these models as native perplexity models.

Useful? React with 👍 / 👎.

Comment thread packages/proxy/schema/index.ts Outdated
"databricks-qwen35-122b-a10b": ["databricks"],
"databricks-qwen3-next-80b-a3b-instruct": ["databricks"],
"thinkingmachines/inkling": ["baseten"],
"thinkingmachines/inkling": ["baseten", "openrouter", "together"],

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Keep OpenRouter out of native direct mapping

When adding Together for thinkingmachines/inkling, this line also adds openrouter to a multi-provider direct mapping. The sync logic in providersForExactModelName() deliberately filters openrouter unless it is the only provider, and the corresponding test asserts this for native multi-provider models; otherwise getDirectModelEndpointTypes("thinkingmachines/inkling") can select the OpenRouter aggregator even though the model has native Baseten/Together routes. This entry should omit openrouter and only add the native provider that changed.

Useful? React with 👍 / 👎.

Erin McNulty (erin2722) and others added 2 commits August 7, 2026 13:48
…5895)

Two fixes on this bot-issues PR:

1. Remove perplexity/kimi-k3 and perplexity/glm-5.2. These are Perplexity
   *Gateway* (router) models — third-party Kimi/GLM served by Perplexity — which
   are only reachable at https://api.perplexity.ai/router/v1/chat/completions
   (per the Perplexity gateway quickstart). But the `perplexity` provider points
   at the standard https://api.perplexity.ai in BOTH the TS proxy
   (EndpointProviderToBaseURL.perplexity) and lingua
   (providers/openai.rs: url "https://api.perplexity.ai"), which only serves
   Sonar. So these ids cannot be routed to the gateway endpoint and are not
   invocable. (Confirms the codex P1/P2.) Could not invocation-validate either
   way: the CI Perplexity secret is currently quota-exhausted (401 "exceeded your
   current quota" on every perplexity model incl. the sonar control), so this is
   also blocked on env. Removed from model_list.json + index.ts and added to
   MANUAL_SYNC_EXCLUDED_MODELS so the daily bot does not re-add them until a
   perplexity-router base URL/provider exists. Same pattern as the mythos
   (bedrock-mantle) and Vertex-MaaS exclusions.

2. thinkingmachines/inkling index.ts mapping: the PR set it to
   ["baseten", "openrouter", "together"], but per BT-5895 openrouter must be
   excluded from a native model's direct AvailableEndpointTypes when other
   providers exist (providersForExactModelName filters it). Corrected to
   ["baseten", "together"] (model_list available_providers keeps openrouter).

+ tests for both exclusions.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@erin2722
Erin McNulty (erin2722) merged commit 0e777bc into main Aug 7, 2026
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

1 participant