IBM WatsonX

Models overview

Some of the supported models:

• ibm/granite-20b-code-instruct
• ibm/granite-3-2b-instruct
• ibm/granite-3-8b-instruct
• meta-llama/llama-3-1-70b-instruct
• meta-llama/llama-3-1-8b-instruct
• meta-llama/llama-3-2-11b-vision-instruct
• meta-llama/llama-3-3-70b-instruct
• mistralai/mistral-large
• mistralai/mistral-small-24b-instruct-2501
• mistralai/mixtral-8x7b-instruct-v01
• mistralai/pixtral-12b

Note: Fork and clone this repository if needed

1. Create and activate a virtual environment

python3 -m venv ~/.venvs/aienv
source ~/.venvs/aienv/bin/activate

2. Export your AWS Credentials

export IBM_WATSONX_API_KEY=***
export IBM_WATSONX_PROJECT_ID=***
export IBM_WATSONX_URL=*** (optional, defaults to https://eu-de.ml.cloud.ibm.com)

3. Install libraries

uv pip install -U ibm-watsonx-ai ddgs agno

4. Run basic agent

• Streaming on

python cookbook/92_models/ibm/watsonx/basic_stream.py

• Streaming off

python cookbook/92_models/ibm/watsonx/basic.py

5. Run Agent with Tools

• DuckDuckGo Search

python cookbook/92_models/ibm/watsonx/tool_use.py

6. Run Agent that returns structured output

python cookbook/92_models/ibm/watsonx/structured_output.py

7. Run Agent that uses storage

python cookbook/92_models/ibm/watsonx/storage.py

8. Run Agent that uses knowledge

python cookbook/92_models/ibm/watsonx/knowledge.py

9. Run Agent that uses images

python cookbook/92_models/ibm/watsonx/image_agent.py