ContextQMD
Back to Llama Index

Netmind AI LLM

docs/examples/llm/netmind.ipynb

0.14.211.6 KB
Original Source

Netmind AI LLM

This notebook shows how to use Netmind AI as an LLM. Check out the full list of models netmind.ai.

Visit https://www.netmind.ai/ and sign up to get an API key.

Setup

If you're opening this Notebook on colab, you will probably need to install LlamaIndex 🦙.

python
%pip install llama-index-llms-netmind
python
!pip install llama-index
python
from llama_index.llms.netmind import NetmindLLM
python
# set api key in env or in llm
# import os
# os.environ["NETMIND_API_KEY"] = "your api key"

llm = NetmindLLM(
    model="meta-llama/Llama-3.3-70B-Instruct", api_key="your api key"
)
python
resp = llm.complete("Is 9.9 or 9.11 bigger?")
python
print(resp)

Call chat with a list of messages

python
from llama_index.core.llms import ChatMessage

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality"
    ),
    ChatMessage(role="user", content="What is your name"),
]
resp = llm.chat(messages)
python
print(resp)

Streaming

Using stream_complete endpoint

python
response = llm.stream_complete("Who is Paul Graham?")
python
for r in response:
    print(r.delta, end="")

Using stream_chat endpoint

python
from llama_index.core.llms import ChatMessage

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality"
    ),
    ChatMessage(role="user", content="What is your name"),
]
resp = llm.stream_chat(messages)
python
for r in resp:
    print(r.delta, end="")