Novita - Continue — ContextQMD

Novita AI offers an affordable, reliable, and simple inference platform with scalable LLM API, empowering developers to build AI applications. Try the Novita AI Llama 3 API Demo today!. You can sign up here, copy your API key on the Key Management, and then hit the play button on any model from the Novita AI Models list. Change ~/.continue/config.json to look like this:

<Tabs> <Tab title="YAML"> ```yaml title="config.yaml" name: My Config version: 0.0.1 schema: v1

models: - name: Llama 3.1 8B provider: novita model: meta-llama/llama-3.1-8b-instruct apiKey: <YOUR_NOVITA_API_KEY>

</Tab>
<Tab title="JSON">
```json title="config.json"
{
  "models": [
    {
      "title": "Llama 3.1 8B",
      "provider": "novita",
      "model": "meta-llama/llama-3.1-8b-instruct",
      "apiKey": "<YOUR_NOVITA_API_KEY>"
    }
  ]
}

</Tab> </Tabs>

View the source