Overview

The TensorZero Gateway integrates with the major LLM providers.

Model Providers

Provider	Chat Functions	JSON Functions	Streaming	Tool Use	Multimodal	Embeddings	Batch
Anthropic	✅	✅	✅	✅	✅	❌	❌
AWS Bedrock	✅	✅	✅	✅	✅	❌	❌
AWS SageMaker	✅	✅	✅	✅	❌	❌	❌
Azure	✅	✅	✅	✅	❌	✅	❌
DeepSeek	✅	✅	⚠️	✅	❌	❌	❌
Fireworks AI	✅	✅	✅	✅	❌	❌	❌
GCP Vertex AI Anthropic	✅	✅	✅	✅	✅	❌	❌
GCP Vertex AI Gemini	✅	✅	✅	✅	✅	❌	✅
Google AI Studio Gemini	✅	✅	✅	✅	✅	❌	❌
Groq	✅	✅	✅	✅	✅	❌	❌
Hyperbolic	✅	⚠️	✅	❌	❌	❌	❌
Mistral	✅	✅	✅	✅	❌	❌	❌
OpenAI and
<span style={{whiteSpace: 'nowrap'}}>OpenAI-Compatible</span>	✅	✅	✅	✅	✅	✅	✅
OpenRouter	✅	✅	✅	✅	✅	✅	❌
SGLang	✅	✅	✅	✅	❌	❌	❌
TGI	✅	✅	⚠️	❌	❌	❌	❌
Together AI	✅	✅	✅	✅	❌	❌	❌
vLLM	✅	✅	✅	✅	❌	❌	❌
xAI	✅	✅	✅	✅	❌	❌	❌