Back to Mem0

Together

docs/components/llms/models/together.mdx

2.0.122.7 KB
Original Source

To use Together LLM models, you have to set the TOGETHER_API_KEY environment variable. You can obtain the Together API key from their Account settings page. In the TypeScript SDK, you can optionally set TOGETHER_API_BASE or pass baseURL in the config (defaults to https://api.together.ai/v1).

Usage

<CodeGroup> ```python Python import os from mem0 import Memory

os.environ["OPENAI_API_KEY"] = "your-api-key" # used for embedding model os.environ["TOGETHER_API_KEY"] = "your-api-key"

config = { "llm": { "provider": "together", "config": { "model": "MiniMaxAI/MiniMax-M3", "temperature": 0.2, "max_tokens": 2000, } } }

m = Memory.from_config(config) messages = [ {"role": "user", "content": "I'm planning to watch a movie tonight. Any recommendations?"}, {"role": "assistant", "content": "How about thriller movies? They can be quite engaging."}, {"role": "user", "content": "I'm not a big fan of thriller movies but I love sci-fi movies."}, {"role": "assistant", "content": "Got it! I'll avoid thriller recommendations and suggest sci-fi movies in the future."} ] m.add(messages, user_id="alice", metadata={"category": "movies"})


```typescript TypeScript
import { Memory } from 'mem0ai/oss';

const config = {
  llm: {
    provider: 'together',
    config: {
      apiKey: process.env.TOGETHER_API_KEY || '',
      model: 'MiniMaxAI/MiniMax-M3',
      temperature: 0.2,
      maxTokens: 2000,
    },
  },
};

const memory = new Memory(config);
const messages = [
  { role: "user", content: "I'm planning to watch a movie tonight. Any recommendations?" },
  { role: "assistant", content: "How about thriller movies? They can be quite engaging." },
  { role: "user", content: "I'm not a big fan of thriller movies but I love sci-fi movies." },
  { role: "assistant", content: "Got it! I'll avoid thriller recommendations and suggest sci-fi movies in the future." },
];
await memory.add(messages, { userId: 'alice', metadata: { category: 'movies' } });
</CodeGroup>

You can also configure the API base URL in the config:

<CodeGroup> ```python Python config = { "llm": { "provider": "together", "config": { "model": "MiniMaxAI/MiniMax-M3", "api_key": "your-api-key" } } } ```
typescript
const config = {
  llm: {
    provider: "together",
    config: {
      model: "MiniMaxAI/MiniMax-M3",
      baseURL: "https://api.together.ai/v1",
      apiKey: "your-api-key",
    },
  },
};
</CodeGroup>

Config

All available parameters for the together config are present in Master List of All Params in Config.