ktransformers/doc/en/kt-kernel/kt-cli.md

KT-CLI

⚠️ Note: This feature is currently under active development. Many functionalities are not yet complete and are being improved. Please stay tuned for updates.

Design Philosophy

KT-CLI is designed to minimize the burden of reading documentation. Instead of requiring users to read lengthy docs, the CLI provides:

• Interactive Mode: Run commands without arguments to get step-by-step guided prompts
• Direct Mode: Pass arguments directly for automation and scripting

  💡 Tip: The arguments are fully compatible with the previous SGLang + KTransformers approach, so you can migrate seamlessly.

Simply run a command, and the CLI will interactively guide you through the process!

Usage

You can check the usage by kt --help

kt [OPTIONS] COMMAND [ARGS]...

KTransformers CLI - A unified command-line interface for KTransformers.

Options

Option	Description
--help	Show this message and exit.

Commands

Command	Description
version	Show version information
chat	Interactive chat with running model
quant	Quantize model weights
bench	Run full benchmark
microbench	Run micro-benchmark
doctor	Diagnose environment issues
model	Manage models and storage paths
config	Manage configuration
sft	Fine-tuning with LlamaFactory