Groq Cookbook

Note: Fork and clone this repository if needed

1. Create and activate a virtual environment

python3 -m venv ~/.venvs/aienv
source ~/.venvs/aienv/bin/activate

2. Export your GROQ_API_KEY

export GROQ_API_KEY=***

3. Install libraries

uv pip install -U groq ddgs duckdb yfinance agno

4. Run basic Agent

• Streaming on

python cookbook/92_models/groq/basic_stream.py

• Streaming off

python cookbook/92_models/groq/basic.py

5. Run Agent with Tools

• DuckDuckGo Search

python cookbook/92_models/groq/tool_use.py

• Research using Exa

python cookbook/92_models/groq/research_agent_exa.py

6. Run Agent that returns structured output

python cookbook/92_models/groq/structured_output.py

7. Run Agent that uses storage

Please run pgvector in a docker container using:

./cookbook/run_pgvector.sh

Then run the following:

python cookbook/92_models/groq/storage.py

8. Run Agent that uses knowledge

python cookbook/92_models/groq/knowledge.py

Take note that by default, OpenAI embeddings are used and an API key will be required. Alternatively, there are other embedders available that can be used. See more examples in /cookbook/07_knowledge/embedders

9. Run Agent that analyzes an image

python cookbook/92_models/groq/image_agent.py

10. Run in async mode

python cookbook/92_models/groq/async/basic_stream.py

python cookbook/92_models/groq/async/basic.py