ContextQMD
Back to Baml

Together AI

fern/03-reference/baml/clients/providers/together.mdx

0.222.0478 B
Original Source

Together AI supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

See https://docs.together.ai/docs/openai-api-compatibility for more information.

baml
client<llm> MyClient {
  provider "openai-generic"
  options {
    base_url "https://api.together.ai/v1"
    api_key env.TOGETHER_API_KEY
    model "meta-llama/Llama-3-70b-chat-hf"
  }
}