ContextQMD
Back to Llama Cpp

README

examples/batched.swift/README.md

latest112 B
Original Source

This is a swift clone of examples/batched.

bash
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]