compare-llama-vs-gpt (Llama Gpt Comparison)

You can run this example with:

npx promptfoo@latest init --example compare-llama-vs-gpt
cd compare-llama-vs-gpt

Usage

To get started, set your OPENAI_API_KEY and REPLICATE_API_TOKEN environment variables.

Next, change a few of the prompts in prompts.txt and edit promptfooconfig.yaml.

Then run:

promptfoo eval

Afterwards, you can view the results by running promptfoo view