ContextQMD
Back to Agno

Model Providers

cookbook/90_models/README.md

2.6.41.1 KB
Original Source

Model Providers

Examples for all supported LLM providers in Agno.

Providers

ProviderDescriptionAPI Key
OpenAIGPT-4, GPT-4o, o1, o3OPENAI_API_KEY
AnthropicClaude 3.5, Claude OpusANTHROPIC_API_KEY
GoogleGemini Pro, FlashGOOGLE_API_KEY
AWS BedrockClaude, Llama on AWSAWS credentials
Azure OpenAIOpenAI on AzureAZURE_*
GroqFast Llama, MixtralGROQ_API_KEY
DeepSeekDeepSeek R1 reasoningDEEPSEEK_API_KEY
MistralMistral, MixtralMISTRAL_API_KEY
CohereCommand R+CO_API_KEY
OllamaLocal modelsLocal
LM StudioLocal GUILocal
llama.cppLocal GGUFLocal

Getting Started

bash
# Install provider
uv pip install agno openai

# Set API key
export OPENAI_API_KEY=your-key

# Run example
python cookbook/92_models/openai/basic.py

Common Patterns

Each provider folder contains:

  • basic.py - Simple completion
  • streaming.py - Streaming responses
  • tool_use.py - Function calling
  • structured_output.py - Pydantic output