LiteLLM A121 Tutorial

This walks through using A121 Jurassic models

python

!pip install litellm

python

from litellm import completion
import os

Set A121 Keys

python

os.environ["AI21_API_KEY"] = ""

python

messages = [{ "content": "Hello, how are you?","role": "user"}]
response = completion(model="j2-light", messages=messages)
response

python

messages = [{ "content": "what model are you","role": "user"}]
response = completion(model="j2-mid", messages=messages)
response

python

messages = [{ "content": "what model are you","role": "user"}]
response = completion(model="j2-ultra", messages=messages)
response