Back to Candle

README

candle-examples/examples/onnx-llm/README.md

0.10.1295 B
Original Source

Using ONNX models in Candle

This example demonstrates how to run ONNX based LLM models in Candle.

This script only implements SmolLM-135M right now.

You can run the examples with following commands:

bash
cargo run --example onnx-llm --features onnx