Skip to content

Latest commit

 

History

9 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Custom Providers for Agent Zero

Add and manage custom model providers directly from the Agent Zero UI — no YAML editing, no server restart.

A + button appears right next to the Provider dropdown in Settings → Models → Edit Model Presets. Click it, fill in the base URL and API key, and the provider appears in the dropdown instantly — in every model slot (Main, Utility, Embedding).


Features

  • Add providers from the UI — OpenAI-compatible endpoints (NanoGPT, vLLM, Ollama, local servers, …) or other LiteLLM providers (Anthropic, Gemini, …) with their own base URL, API key, and model list endpoint
  • Edit / rename / delete existing custom providers — including automatic API-key migration on rename
  • Model search — uses your provider's /models endpoint so you can browse models without typing IDs by hand
  • Test connection — verify the endpoint and key before saving
  • Keys never stored in YAML — API keys go to your Agent Zero .env as API_KEY_<ID> (dotenv), same as built-in providers
  • Hot reload — no server restart: new providers are picked up by the running framework immediately

How it works

The plugin stores providers in its own conf/model_providers.yaml and merges them into the running provider list through Agent Zero's provider configuration, without touching core files. Per-provider config uses the standard Agent Zero provider shape:

chat:
  my_provider:
    name: My Provider
    litellm_provider: openai
    models_list:
      endpoint_url: /models
      format: openai
    kwargs:
      api_base: https://my-provider.example.com/v1
      a0_api_mode: chat

Installation

From Zip

  1. Download the code as ZIP.

  2. Agent Zero → Settings → Plugins → Install → From ZIP → select the ZIP

  3. Restart Agent Zero.

From Git

git clone https://github.com/GreifMax/a0-custom-providers
cp -r a0-vision-sidecar /a0/usr/plugins/custom_providers
# restart Agent Zero

Usage

  1. In Edit Model Presets, click + next to a Provider dropdown.
  2. Give the provider a name — the id is auto-generated (new providers start pre-filled with example values; change them for your provider).
  3. Enter the API base URL (e.g. https://nano-gpt.com/api/v1).
  4. (Optional) Adjust the models endpoint — defaults to /models, relative to the API base.
  5. Add the API key and hit Save.
  6. The new provider is selected automatically in the slot where you clicked + — finish your preset and save.

API keys

Keys are stored in Agent Zero's dotenv (.env) as API_KEY_<PROVIDER_ID_UPPER> — e.g. API_KEY_NANO_GPT. You can also set them under Settings → API Keys. Existing keys survive edits; only a newly entered key is written.

Security notes

  • API keys never land in model_providers.yaml or in chat history.
  • The connection test only performs a GET to the /models endpoint with the key as a Bearer token.
  • The plugin is read-only with respect to the rest of your Agent Zero install: all state lives in the plugin folder and .env.

License

MIT

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages