kvcache-ai/ktransformers
1
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-20 14:29:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,101 Commits 46 Branches 28 Tags
c2d2edbeefb493e627686709edb10b09d453ca76
Commit Graph

164 Commits

Author SHA1 Message Date
ZiWei Yuan
c32fefb1cd [doc]: update web doc and kt-kernel doc (#1609) 
* [doc]: update web doc and kt-kernel doc

* [doc](book.toml): add book.toml for rust book compile
 2025-11-13 20:44:13 +08:00
Peilin Li
148a030026 upload hands-on tutorial with KTransformers-FT, especially in customize your KT-FT+LLaMA-Factory (#1597) 
* Add files via upload

* upload hands-on tutorial for KTransformers-FT
 2025-11-11 20:54:41 +08:00
Wenzhang-Chen
62b7b28a16 fix typo (#1452) 2025-11-10 16:08:04 +08:00
Atream
b67cc4095d Change attention backend to 'flashinfer' in launch command 
Updated the launch command to include 'flashinfer' as the attention backend.
 2025-11-08 20:56:09 +08:00
Peilin Li
f4fe137023 Merge pull request #1572 from JimmyPeilinLi/main 
fix: remove py310 as guide
 2025-11-08 16:57:10 +08:00
JimmyPeilinLi
1c08a4f0fb fix: remove py310 as guide 2025-11-08 08:54:32 +00:00
Atream
0651dbda04 Simplify launch command by removing unused option 
Removed the unused '--attention-backend triton' option from the launch command.
 2025-11-08 16:54:18 +08:00
Atream
d6ee384fe2 Fix download link for Kimi-K2-Thinking weights 
Updated the download link for AMX INT4 quantized weights.
 2025-11-06 19:07:15 +08:00
Atream
d419024bb4 Add KTransformers SGLang inference documentation 
Add documentation for KTransformers SGLang inference deployment, including installation steps, model download links, server launch instructions, and performance benchmarks.
 2025-11-06 17:53:58 +08:00
Peilin Li
803e645bc1 Update SFT Installation Guide for KimiK2 
Added installation instructions and usage examples for KimiK2.
 2025-11-06 17:34:21 +08:00
Peilin Li
d7ec838d5a installation guide for KT+SFT(LoRA) in KimiK2 model 2025-11-06 17:27:42 +08:00
ZiWei Yuan
8192cc4166 Merge pull request #1551 from kvcache-ai/JimmyPeilinLi-patch-1 
Revise GPU/CPU memory footprint information
 2025-11-05 12:23:28 +08:00
Peilin Li
6721f8765d Revise GPU/CPU memory footprint information 
Updated memory footprint details for DeepSeek models.
 2025-11-05 12:11:19 +08:00
Peilin Li
4f9940700e Update installation instructions 2025-11-04 23:06:05 +08:00
KMSorSMS
0c15da437f [feat](cmake & doc): fix bug with cmake arch detect & update doc for sft 2025-11-04 08:46:26 +00:00
JimmyPeilinLi
7b6ccc3f57 add the docs and update README for KSFT 2025-11-04 05:51:48 +00:00
djw
0437660e62 fix bug 2025-09-16 13:21:58 +00:00
djw
a44b710649 support qwen3 next 2025-09-11 11:55:09 +00:00
Atream
64b3b30ba3 Update GGUF format link in Kimi-K2 documentation 2025-09-05 20:19:37 +08:00
Azure-Tang
b6d36bffbb update kimi-k2-0905 2025-09-05 03:52:43 +00:00
djw
5771990a07 update smallthinker and glm4 readme 2025-07-31 03:14:49 +00:00
djw
c7307aa0ae support smt and glm4 2025-07-25 16:24:38 +00:00
djw
17246bf84f support smt and glm4 2025-07-25 15:03:27 +00:00
chenxl
b5024f62a4 Update Kimi-K2 Readme 2025-07-12 12:51:00 +08:00
Atream
34d2829f24 Update Kimi-K2.md 2025-07-12 12:44:41 +08:00
Atream
90245d8a6b Update Kimi-K2.md 2025-07-12 11:57:51 +08:00
Atream
378e4fc035 Update Kimi-K2.md 2025-07-12 11:47:42 +08:00
Atream
b4ed8b6ded Update Kimi-K2.md 2025-07-11 23:26:18 +08:00
UnicornChan
7800a413a2 Update Kimi-K2.md 2025-07-11 19:31:58 +08:00
Atream
b4ac21454b Create Kimi-K2.md 2025-07-11 09:31:47 +08:00
ouqingliang
90cff820cf update kvc disk path config. 2025-06-30 15:09:35 +00:00
ErvinXie
5a73aaf652 Update prefix_cache.md 2025-06-30 15:04:37 +08:00
ouqingliang
cc822df65d add prefix cache documentation 2025-06-28 07:13:33 +00:00
Shaojun Liu
404ad39a04 docs: add Dockerfile.xpu and GPU driver setup instructions 
- Add Dockerfile.xpu for oneAPI-based container
- Create Docker_xpu.md with usage instructions
- Update xpu.md to include Docker guide
 2025-05-28 13:55:35 +08:00
rnwang04
adc0906967 add XPU support for qwen3moe local chat 2025-05-22 21:01:41 +08:00
wang jiahao
32f3d7befb Merge pull request #1307 from kvcache-ai/hyc 
add xpu parameters to install.sh
 2025-05-17 15:25:33 +08:00
rnwang04
a56aa45186 fix ipex-llm version to 2.3.0rc1 2025-05-16 12:22:08 +08:00
Shaoyuan CHEN
5d194c5db0 Fix typos 2025-05-15 22:15:55 +08:00
Atream
7faa776659 Merge pull request #1277 from Coekjan/patch-1 
Fix typo about `GLIBCXX_3.4.32`
 2025-05-15 01:58:00 -06:00
Alisehen
055680e26c add flashinfer to cuda device 2025-05-15 07:03:45 +00:00
Alisehen
f3be33a313 add xpu parameters to install.sh 2025-05-15 06:39:02 +00:00
Aubrey Li
72f6d93ffd xpu.md: add device discovery tips 2025-05-15 14:12:26 +08:00
rnwang04
2f6e14a54b fix md typo, fix code style, and update setup value error message 2025-05-15 10:14:39 +00:00
qiyuxinlin
d35d61f6a1 update readme 2025-05-14 13:15:18 +00:00
qiyuxinlin
c3d0ac80c6 update readme 2025-05-14 13:13:10 +00:00
rnwang04
142fb7ce6c Enable support for Intel XPU devices, add support for DeepSeek V2/V3 first 2025-05-14 19:37:27 +00:00
Yip Coekjan
1edc6d9de0 Fix typo about GLIBCXX_3.4.32 2025-05-09 20:34:45 +08:00
Atream
28948aacc9 Update AMX.md 2025-04-29 11:12:51 +08:00
Atream
14efb15593 Update AMX.md 2025-04-29 11:03:59 +08:00
Atream
073ce601e0 Update AMX.md 2025-04-29 10:29:51 +08:00