Back to Candle

gte-Qwen1.5-7B-instruct

candle-examples/examples/gte-qwen/README.md

0.10.1624 B
Original Source

gte-Qwen1.5-7B-instruct

gte-Qwen1.5-7B-instruct is a variant of the GTE embedding model family.

Running the example

Automatically download the model from the HuggingFace hub:

bash
$ cargo run --example gte-qwen --release

or, load the model from a local directory:

bash
cargo run --example gte-qwen --release --features cuda -- --local-repo /path/to/gte_Qwen1.5-7B-instruct/