Ktransformers

Introduction

Install & Usage

• For kt-kernel
• For kt-sft

Tutorial

• kt-sft part
  • KT-FT Fine-Tuning and Inference Loop
  • KT-FT 微调推理闭环
  • Injection Tutorial
  • kt-sft developer tech notes
  • DPO tutorial
  <!-- - [Multi-GPU Tutorial](en/multi-gpu-tutorial.md) --> <!-- - [Use FP8 GPU Kernel](en/fp8_kernel.md) --> <!-- - [Use AMD GPU](en/ROCm.md) -->

<!-- - [Deepseek-R1/V3 Show Case/Tutorial](en/DeepseekR1_V3_tutorial.md) --> <!-- - [Why KTransformers So Fast](en/deepseek-v2-injection.md) --> <!-- # For Developer - [Makefile Usage](en/makefile_usage.md) -->

• kt-kernel part
  • kt-cli
  • AVX2 Backend Tutorial
  • AVX2 后端教程（中文）
  • SYCL GPTQ INT4 后端教程（中文）

FAQ

• FAQ

<!-- # V3 Reproduction - [Success List](en/V3-success.md) # Benchmark - [Benchmark](en/benchmark.md) -->