Back to Sglang

README

benchmark/json_schema/README.md

0.5.11204 B
Original Source

Run benchmark

Benchmark sglang

Run Llama-8b

bash
python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --port 30000

Benchmark

bash
python3 bench_sglang.py