docs/en/models/custom.mdx
For model services accessed via the OpenAI-compatible protocol or locally deployed models, such as:
{
"bot_type": "custom",
"model": "",
"custom_api_key": "YOUR_API_KEY",
"custom_api_base": "https://{your-proxy.com}/v1"
}
| Parameter | Description |
|---|---|
bot_type | Must be set to custom |
model | Model name; any model name supported by the proxy service |
custom_api_key | API key provided by the proxy service |
custom_api_base | API endpoint provided by the proxy service; must be OpenAI-compatible |
Local models usually do not require an API key — only the API base needs to be filled in:
{
"bot_type": "custom",
"model": "qwen3.5:27b",
"custom_api_base": "http://localhost:11434/v1"
}
Common local deployment tools and their default endpoints:
| Tool | Default API Base |
|---|---|
| Ollama | http://localhost:11434/v1 |
| vLLM | http://localhost:8000/v1 |
| LocalAI | http://localhost:8080/v1 |
Switching models under a custom vendor only changes model — bot_type and the API endpoint remain unchanged:
/config model qwen3.5:27b