Grok 4

Grok from xAI uses an OpenAI-compatible API, so you can use it with the OpenAILike integration class.

python

!pip install llama-index-llms-openai-like

python

grok_api_key = "xai-xxxxxxxx"

python

from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(
    model="grok-4-0709",
    api_base="https://api.x.ai/v1",
    api_key=grok_api_key,
    context_window=128000,
    is_chat_model=True,
    is_function_calling_model=False,
)

response = llm.complete("Hello World!")
print(str(response))