Back to Chroma

Together AI

docs/mintlify/integrations/embedding-models/together-ai.mdx

1.5.91.4 KB
Original Source

Chroma provides a wrapper around Together AI embedding models. This embedding function runs remotely against the Together AI servers, and will require an API key and a Together AI account. You can find more information in the Together AI Embeddings Docs, and supported models.

<CodeGroup>
python
from chromadb.utils.embedding_functions import TogetherAIEmbeddingFunction

os.environ["CHROMA_TOGETHER_AI_API_KEY"] = "<INSERT API KEY HERE>"

ef = TogetherAIEmbeddingFunction(
    model_name="togethercomputer/m2-bert-80M-32k-retrieval",
)
ef(input=["This is my first text to embed", "This is my second document"])
typescript
// npm install @chroma-core/together-ai

import { TogetherAIEmbeddingFunction } from '@chroma-core/together-ai';

process.env.TOGETHER_AI_API_KEY = "<INSERT API KEY HERE>"

const embedder = new TogetherAIEmbeddingFunction({
    model_name: "togethercomputer/m2-bert-80M-32k-retrieval",
});

// use directly
embedder.generate(['This is my first text to embed', 'This is my second document']);
</CodeGroup>

You must pass in a model_name to the embedding function. It is recommended to set the CHROMA_TOGETHER_AI_API_KEY environment variable for the API key, but the embedding function also optionally takes in an api_key parameter directly.