KT-CLI

⚠️ Note: This feature is currently under active development. Many functionalities are not yet complete and are being improved. Please stay tuned for updates.

Design Philosophy

KT-CLI is designed to minimize the burden of reading documentation. Instead of requiring users to read lengthy docs, the CLI provides:

Interactive Mode: Run commands without arguments to get step-by-step guided prompts
Direct Mode: Pass arguments directly for automation and scripting

💡 Tip: The arguments are fully compatible with the previous SGLang + KTransformers approach, so you can migrate seamlessly.

Simply run a command, and the CLI will interactively guide you through the process!

Usage

You can check the usage by kt --help

kt [OPTIONS] COMMAND [ARGS]...

KTransformers CLI - A unified command-line interface for KTransformers.

Options

Option	Description
`--help`	Show this message and exit.

Commands

Command	Description
`version`	Show version information
`chat`	Interactive chat with running model
`quant`	Quantize model weights
`bench`	Run full benchmark
`microbench`	Run micro-benchmark
`doctor`	Diagnose environment issues
`model`	Manage models and storage paths
`config`	Manage configuration
`sft`	Fine-tuning with LlamaFactory