Back to Ai

AI SDK - DeepInfra Provider

packages/deepinfra/README.md

2.1.101.2 KB
Original Source

AI SDK - DeepInfra Provider

The DeepInfra provider for the AI SDK contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-the-art LLMs.

Setup

The DeepInfra provider is available in the @ai-sdk/deepinfra module. You can install it with

bash
npm i @ai-sdk/deepinfra

Skill for Coding Agents

If you use coding agents such as Claude Code or Cursor, we highly recommend adding the AI SDK skill to your repository:

shell
npx skills add vercel/ai

Provider Instance

You can import the default provider instance deepinfra from @ai-sdk/deepinfra:

ts
import { deepinfra } from '@ai-sdk/deepinfra';

Example

ts
import { deepinfra } from '@ai-sdk/deepinfra';
import { generateText } from 'ai';

const { text } = await generateText({
  model: deepinfra('meta-llama/Llama-3.3-70B-Instruct'),
  prompt: 'Write a vegetarian lasagna recipe for 4 people.',
});

Documentation

Please check out the DeepInfra provider documentation for more information.