Back to Powerinfer

README

examples/batched.swift/README.md

latest97 B
Original Source

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]