ContextQMD
Back to Powerinfer

README

smallthinker/examples/batched.swift/README.md

latest111 B
Original Source

This is a swift clone of examples/batched.

$ make $ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]