Llamafile - Continue

A llamafile is a self-contained binary that can run an open-source LLM. You can configure this provider in your config.json as follows:

<Tabs> <Tab title="YAML"> ```yaml title="config.yaml" name: My Config version: 0.0.1 schema: v1

models: - name: Llamafile provider: llamafile model: mistral-7b

</Tab>
<Tab title="JSON">
```json title="config.json"
{
  "models": [
    {
      "title": "Llamafile",
      "provider": "llamafile",
      "model": "mistral-7b"
    }
  ]
}

</Tab> </Tabs>

View the source