ContextQMD
Back to Opik

Supported Models for Cost Tracking

apps/opik-documentation/documentation/fern/docs/tracing/supported_models.mdx

2.0.22-6605-merge-206513.8 KB
Original Source

Supported Models for Cost Tracking

This page lists all models that Opik supports for automatic cost tracking. Cost tracking is automatically enabled when using any of the supported integrations with these models.

<Note> This page is automatically generated from the latest model pricing data and shows which models have cost tracking support. </Note>

Overview

Opik supports cost tracking for 359 models across 7 providers:

<h2 id="aws-bedrock">AWS Bedrock</h2>

Models hosted by AWS Bedrock • Learn more

116 models supported

<details> <summary>View all AWS Bedrock models</summary>
  • ai21.j2-mid-v1
  • ai21.j2-ultra-v1
  • ai21.jamba-1-5-large-v1:0
  • ai21.jamba-1-5-mini-v1:0
  • ai21.jamba-instruct-v1:0
  • amazon.nova-lite-v1:0
  • amazon.nova-micro-v1:0
  • amazon.nova-pro-v1:0
  • amazon.titan-embed-image-v1
  • amazon.titan-embed-text-v1
  • amazon.titan-embed-text-v2:0
  • amazon.titan-text-express-v1
  • amazon.titan-text-lite-v1
  • amazon.titan-text-premier-v1:0
  • anthropic.claude-3-5-haiku-20241022-v1:0
  • anthropic.claude-3-5-sonnet-20240620-v1:0
  • anthropic.claude-3-5-sonnet-20241022-v2:0
  • anthropic.claude-3-7-sonnet-20250219-v1:0
  • anthropic.claude-3-haiku-20240307-v1:0
  • anthropic.claude-3-opus-20240229-v1:0
  • anthropic.claude-3-sonnet-20240229-v1:0
  • anthropic.claude-instant-v1
  • anthropic.claude-opus-4-1-20250805-v1:0
  • anthropic.claude-opus-4-20250514-v1:0
  • anthropic.claude-sonnet-4-20250514-v1:0
  • anthropic.claude-v1
  • anthropic.claude-v2:1
  • apac.amazon.nova-lite-v1:0
  • apac.amazon.nova-micro-v1:0
  • apac.amazon.nova-pro-v1:0
  • apac.anthropic.claude-3-5-sonnet-20240620-v1:0
  • apac.anthropic.claude-3-5-sonnet-20241022-v2:0
  • apac.anthropic.claude-3-haiku-20240307-v1:0
  • apac.anthropic.claude-3-sonnet-20240229-v1:0
  • apac.anthropic.claude-sonnet-4-20250514-v1:0
  • cohere.command-light-text-v14
  • cohere.command-r-plus-v1:0
  • cohere.command-r-v1:0
  • cohere.command-text-v14
  • cohere.embed-english-v3
  • cohere.embed-multilingual-v3
  • deepseek.v3-v1:0
  • eu.amazon.nova-lite-v1:0
  • eu.amazon.nova-micro-v1:0
  • eu.amazon.nova-pro-v1:0
  • eu.anthropic.claude-3-5-haiku-20241022-v1:0
  • eu.anthropic.claude-3-5-sonnet-20240620-v1:0
  • eu.anthropic.claude-3-5-sonnet-20241022-v2:0
  • eu.anthropic.claude-3-7-sonnet-20250219-v1:0
  • eu.anthropic.claude-3-haiku-20240307-v1:0
  • eu.anthropic.claude-3-opus-20240229-v1:0
  • eu.anthropic.claude-3-sonnet-20240229-v1:0
  • eu.anthropic.claude-opus-4-1-20250805-v1:0
  • eu.anthropic.claude-opus-4-20250514-v1:0
  • eu.anthropic.claude-sonnet-4-20250514-v1:0
  • eu.meta.llama3-2-1b-instruct-v1:0
  • eu.meta.llama3-2-3b-instruct-v1:0
  • eu.mistral.pixtral-large-2502-v1:0
  • eu.twelvelabs.marengo-embed-2-7-v1:0
  • eu.twelvelabs.pegasus-1-2-v1:0
  • meta.llama2-13b-chat-v1
  • meta.llama2-70b-chat-v1
  • meta.llama3-1-405b-instruct-v1:0
  • meta.llama3-1-70b-instruct-v1:0
  • meta.llama3-1-8b-instruct-v1:0
  • meta.llama3-2-11b-instruct-v1:0
  • meta.llama3-2-1b-instruct-v1:0
  • meta.llama3-2-3b-instruct-v1:0
  • meta.llama3-2-90b-instruct-v1:0
  • meta.llama3-3-70b-instruct-v1:0
  • meta.llama3-70b-instruct-v1:0
  • meta.llama3-8b-instruct-v1:0
  • meta.llama4-maverick-17b-instruct-v1:0
  • meta.llama4-scout-17b-instruct-v1:0
  • mistral.mistral-7b-instruct-v0:2
  • mistral.mistral-large-2402-v1:0
  • mistral.mistral-large-2407-v1:0
  • mistral.mistral-small-2402-v1:0
  • mistral.mixtral-8x7b-instruct-v0:1
  • openai.gpt-oss-120b-1:0
  • openai.gpt-oss-20b-1:0
  • qwen.qwen3-235b-a22b-2507-v1:0
  • qwen.qwen3-32b-v1:0
  • qwen.qwen3-coder-30b-a3b-v1:0
  • qwen.qwen3-coder-480b-a35b-v1:0
  • twelvelabs.marengo-embed-2-7-v1:0
  • twelvelabs.pegasus-1-2-v1:0
  • us.amazon.nova-lite-v1:0
  • us.amazon.nova-micro-v1:0
  • us.amazon.nova-premier-v1:0
  • us.amazon.nova-pro-v1:0
  • us.anthropic.claude-3-5-haiku-20241022-v1:0
  • us.anthropic.claude-3-5-sonnet-20240620-v1:0
  • us.anthropic.claude-3-5-sonnet-20241022-v2:0
  • us.anthropic.claude-3-7-sonnet-20250219-v1:0
  • us.anthropic.claude-3-haiku-20240307-v1:0
  • us.anthropic.claude-3-opus-20240229-v1:0
  • us.anthropic.claude-3-sonnet-20240229-v1:0
  • us.anthropic.claude-opus-4-1-20250805-v1:0
  • us.anthropic.claude-opus-4-20250514-v1:0
  • us.anthropic.claude-sonnet-4-20250514-v1:0
  • us.anthropic.claude-sonnet-4-5-20250929-v1:0
  • us.deepseek.r1-v1:0
  • us.meta.llama3-1-405b-instruct-v1:0
  • us.meta.llama3-1-70b-instruct-v1:0
  • us.meta.llama3-1-8b-instruct-v1:0
  • us.meta.llama3-2-11b-instruct-v1:0
  • us.meta.llama3-2-1b-instruct-v1:0
  • us.meta.llama3-2-3b-instruct-v1:0
  • us.meta.llama3-2-90b-instruct-v1:0
  • us.meta.llama3-3-70b-instruct-v1:0
  • us.meta.llama4-maverick-17b-instruct-v1:0
  • us.meta.llama4-scout-17b-instruct-v1:0
  • us.mistral.pixtral-large-2502-v1:0
  • us.twelvelabs.marengo-embed-2-7-v1:0
  • us.twelvelabs.pegasus-1-2-v1:0
</details> <h2 id="anthropic">Anthropic</h2>

Anthropic models hosted by Anthropic • Learn more

18 models supported

<details> <summary>View all Anthropic models</summary>
  • claude-3-5-haiku-20241022
  • claude-3-5-haiku-latest
  • claude-3-5-sonnet-20240620
  • claude-3-5-sonnet-20241022
  • claude-3-5-sonnet-latest
  • claude-3-7-sonnet-20250219
  • claude-3-7-sonnet-latest
  • claude-3-haiku-20240307
  • claude-3-opus-20240229
  • claude-3-opus-latest
  • claude-4-opus-20250514
  • claude-4-sonnet-20250514
  • claude-opus-4-1
  • claude-opus-4-1-20250805
  • claude-opus-4-20250514
  • claude-sonnet-4-20250514
  • claude-sonnet-4-5
  • claude-sonnet-4-5-20250929
</details> <h2 id="anthropic-on-vertex-ai">Anthropic on Vertex AI</h2>

Anthropic models hosted in Google Vertex AI • Learn more

21 models supported

<details> <summary>View all Anthropic on Vertex AI models</summary>
  • claude-3-5-haiku
  • claude-3-5-haiku@20241022
  • claude-3-5-sonnet
  • claude-3-5-sonnet-v2
  • claude-3-5-sonnet-v2@20241022
  • claude-3-5-sonnet@20240620
  • claude-3-7-sonnet@20250219
  • claude-3-haiku
  • claude-3-haiku@20240307
  • claude-3-opus
  • claude-3-opus@20240229
  • claude-3-sonnet
  • claude-3-sonnet@20240229
  • claude-opus-4
  • claude-opus-4-1
  • claude-opus-4-1@20250805
  • claude-opus-4@20250514
  • claude-sonnet-4
  • claude-sonnet-4-5
  • claude-sonnet-4-5@20250929
  • claude-sonnet-4@20250514
</details> <h2 id="google-ai">Google AI</h2>

Gemini models hosted in Google AI Studio • Learn more

35 models supported

<details> <summary>View all Google AI models</summary>
  • gemini-1.5-flash
  • gemini-1.5-flash-001
  • gemini-1.5-flash-002
  • gemini-1.5-flash-latest
  • gemini-1.5-pro
  • gemini-1.5-pro-001
  • gemini-1.5-pro-002
  • gemini-1.5-pro-exp-0801
  • gemini-1.5-pro-latest
  • gemini-2.0-flash
  • gemini-2.0-flash-001
  • gemini-2.0-flash-lite
  • gemini-2.0-flash-lite-preview-02-05
  • gemini-2.0-flash-live-001
  • gemini-2.0-flash-preview-image-generation
  • gemini-2.5-flash
  • gemini-2.5-flash-image-preview
  • gemini-2.5-flash-lite
  • gemini-2.5-flash-lite-preview-06-17
  • gemini-2.5-flash-lite-preview-09-2025
  • gemini-2.5-flash-preview-04-17
  • gemini-2.5-flash-preview-05-20
  • gemini-2.5-flash-preview-09-2025
  • gemini-2.5-flash-preview-tts
  • gemini-2.5-pro
  • gemini-2.5-pro-preview-03-25
  • gemini-2.5-pro-preview-05-06
  • gemini-2.5-pro-preview-06-05
  • gemini-2.5-pro-preview-tts
  • gemini-flash-latest
  • gemini-flash-lite-latest
  • gemini-gemma-2-27b-it
  • gemini-gemma-2-9b-it
  • gemini-pro
  • gemini-pro-vision
</details> <h2 id="google-vertex-ai">Google Vertex AI</h2>

Gemini models hosted in Google Vertex AI • Learn more

39 models supported

<details> <summary>View all Google Vertex AI models</summary>
  • gemini-1.0-pro
  • gemini-1.0-pro-001
  • gemini-1.0-pro-002
  • gemini-1.0-ultra
  • gemini-1.0-ultra-001
  • gemini-1.5-flash
  • gemini-1.5-flash-001
  • gemini-1.5-flash-002
  • gemini-1.5-flash-exp-0827
  • gemini-1.5-flash-preview-0514
  • gemini-1.5-pro
  • gemini-1.5-pro-001
  • gemini-1.5-pro-002
  • gemini-1.5-pro-preview-0215
  • gemini-1.5-pro-preview-0409
  • gemini-1.5-pro-preview-0514
  • gemini-2.0-flash
  • gemini-2.0-flash-001
  • gemini-2.0-flash-exp
  • gemini-2.0-flash-lite
  • gemini-2.0-flash-lite-001
  • gemini-2.0-flash-live-preview-04-09
  • gemini-2.0-flash-preview-image-generation
  • gemini-2.0-pro-exp-02-05
  • gemini-2.5-flash
  • gemini-2.5-flash-image-preview
  • gemini-2.5-flash-lite
  • gemini-2.5-flash-lite-preview-06-17
  • gemini-2.5-flash-lite-preview-09-2025
  • gemini-2.5-flash-preview-04-17
  • gemini-2.5-flash-preview-05-20
  • gemini-2.5-flash-preview-09-2025
  • gemini-2.5-pro
  • gemini-2.5-pro-exp-03-25
  • gemini-2.5-pro-preview-03-25
  • gemini-2.5-pro-preview-05-06
  • gemini-2.5-pro-preview-06-05
  • gemini-2.5-pro-preview-tts
  • gemini-pro
</details> <h2 id="groq">Groq</h2>

Models hosted by Groq • Learn more

27 models supported

<details> <summary>View all Groq models</summary>
  • deepseek-r1-distill-llama-70b
  • gemma-7b-it
  • gemma2-9b-it
  • llama-3.1-405b-reasoning
  • llama-3.1-70b-versatile
  • llama-3.1-8b-instant
  • llama-3.2-11b-text-preview
  • llama-3.2-11b-vision-preview
  • llama-3.2-1b-preview
  • llama-3.2-3b-preview
  • llama-3.2-90b-text-preview
  • llama-3.2-90b-vision-preview
  • llama-3.3-70b-specdec
  • llama-3.3-70b-versatile
  • llama-guard-3-8b
  • llama2-70b-4096
  • llama3-groq-70b-8192-tool-use-preview
  • llama3-groq-8b-8192-tool-use-preview
  • meta-llama/llama-4-maverick-17b-128e-instruct
  • meta-llama/llama-4-scout-17b-16e-instruct
  • mistral-saba-24b
  • mixtral-8x7b-32768
  • moonshotai/kimi-k2-instruct
  • moonshotai/kimi-k2-instruct-0905
  • openai/gpt-oss-120b
  • openai/gpt-oss-20b
  • qwen/qwen3-32b
</details> <h2 id="openai">OpenAI</h2>

Models hosted by OpenAI • Learn more

103 models supported

<details> <summary>View all OpenAI models</summary>
  • chatgpt-4o-latest
  • codex-mini-latest
  • ft:gpt-3.5-turbo
  • ft:gpt-3.5-turbo-0125
  • ft:gpt-3.5-turbo-0613
  • ft:gpt-3.5-turbo-1106
  • ft:gpt-4-0613
  • ft:gpt-4o-2024-08-06
  • ft:gpt-4o-2024-11-20
  • ft:gpt-4o-mini-2024-07-18
  • gpt-3.5-turbo
  • gpt-3.5-turbo-0125
  • gpt-3.5-turbo-0301
  • gpt-3.5-turbo-0613
  • gpt-3.5-turbo-1106
  • gpt-3.5-turbo-16k
  • gpt-3.5-turbo-16k-0613
  • gpt-4
  • gpt-4-0125-preview
  • gpt-4-0314
  • gpt-4-0613
  • gpt-4-1106-preview
  • gpt-4-1106-vision-preview
  • gpt-4-32k
  • gpt-4-32k-0314
  • gpt-4-32k-0613
  • gpt-4-turbo
  • gpt-4-turbo-2024-04-09
  • gpt-4-turbo-preview
  • gpt-4-vision-preview
  • gpt-4.1
  • gpt-4.1-2025-04-14
  • gpt-4.1-mini
  • gpt-4.1-mini-2025-04-14
  • gpt-4.1-nano
  • gpt-4.1-nano-2025-04-14
  • gpt-4.5-preview
  • gpt-4.5-preview-2025-02-27
  • gpt-4o
  • gpt-4o-2024-05-13
  • gpt-4o-2024-08-06
  • gpt-4o-2024-11-20
  • gpt-4o-audio-preview
  • gpt-4o-audio-preview-2024-10-01
  • gpt-4o-audio-preview-2024-12-17
  • gpt-4o-audio-preview-2025-06-03
  • gpt-4o-mini
  • gpt-4o-mini-2024-07-18
  • gpt-4o-mini-audio-preview
  • gpt-4o-mini-audio-preview-2024-12-17
  • gpt-4o-mini-realtime-preview
  • gpt-4o-mini-realtime-preview-2024-12-17
  • gpt-4o-mini-search-preview
  • gpt-4o-mini-search-preview-2025-03-11
  • gpt-4o-mini-transcribe
  • gpt-4o-mini-tts
  • gpt-4o-realtime-preview
  • gpt-4o-realtime-preview-2024-10-01
  • gpt-4o-realtime-preview-2024-12-17
  • gpt-4o-realtime-preview-2025-06-03
  • gpt-4o-search-preview
  • gpt-4o-search-preview-2025-03-11
  • gpt-4o-transcribe
  • gpt-5
  • gpt-5-2025-08-07
  • gpt-5-chat
  • gpt-5-chat-latest
  • gpt-5-codex
  • gpt-5-mini
  • gpt-5-mini-2025-08-07
  • gpt-5-nano
  • gpt-5-nano-2025-08-07
  • gpt-5.2
  • gpt-5.2-2025-12-11
  • gpt-5.2-chat-latest
  • gpt-5.2-pro
  • gpt-5.2-pro-2025-12-11
  • gpt-realtime
  • gpt-realtime-2025-08-28
  • o1
  • o1-2024-12-17
  • o1-mini
  • o1-mini-2024-09-12
  • o1-preview
  • o1-preview-2024-09-12
  • o1-pro
  • o1-pro-2025-03-19
  • o3
  • o3-2025-04-16
  • o3-deep-research
  • o3-deep-research-2025-06-26
  • o3-mini
  • o3-mini-2025-01-31
  • o3-pro
  • o3-pro-2025-06-10
  • o4-mini
  • o4-mini-2025-04-16
  • o4-mini-deep-research
  • o4-mini-deep-research-2025-06-26
  • text-embedding-3-large
  • text-embedding-3-small
  • text-embedding-ada-002
  • text-embedding-ada-002-v2
</details>

How Cost Tracking Works

Opik automatically calculates costs for the models listed above when using supported integrations. The cost calculation is handled by backend services that:

  1. Detect the model used in your LLM calls
  2. Count tokens in inputs, outputs, and cache if available
  3. Apply current pricing from our model database
  4. Store cost information with your traces and spans

Pricing Data

  • Pricing Data: Model prices are sourced from the model pricing JSON file
  • Real-time Updates: This page is automatically updated when model pricing data changes

Need Support for Additional Models?

If you need cost tracking support for additional models or providers, please open a feature request on our GitHub repository.

<Tip> For the most up-to-date list of supported providers and their enum values, check the `opik.LLMProvider` enum in the Python SDK. </Tip>