Back to Promptfoo

compare-open-source-models (Open-Source Model Comparison)

examples/compare-open-source-models/README.md

0.121.9580 B
Original Source

compare-open-source-models (Open-Source Model Comparison)

This example compares DeepSeek, Mistral, Llama, and Qwen on various tasks with factual assertions using OpenRouter.

See the guide for more details.

Setup

sh
npx promptfoo@latest init --example compare-open-source-models
cd compare-open-source-models

Set the required environment variable:

sh
export OPENROUTER_API_KEY=your-openrouter-key

Run

sh
npx promptfoo@latest eval

View

sh
npx promptfoo@latest view