Azure OpenAI

Azure OpenAI is a cloud-based service that provides Azure customers with access to OpenAI's powerful language models including GPT-4, GPT-3.5, and various embedding models.

Please be aware that azure will be supported starting with version 0.24, which is scheduled for release by end of 01/2025

Chat model

It supports various GPT series chat models through an Azure OpenAI-compatible API interface.

toml

[model.chat.http]
kind = "azure/chat"
model_name = "gpt-4o-mini"
api_endpoint = "https://<resource-name>.openai.azure.com"
api_key = "your-api-key"

Completion model

Azure OpenAI currently does not offer completion-specific API endpoints.

Embeddings model

It supports text-embedding-3-small, text-embedding-3-large and other embedding models through an Azure OpenAI-compatible API interface.

toml

[model.embedding.http]
kind = "azure/embedding"
model_name = "text-embedding-3-large"
api_endpoint = "https://<resource-name>.openai.azure.com"
api_key = "your-api-key"