kvcache-ai/ktransformers
1
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-20 14:29:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1551 from kvcache-ai/JimmyPeilinLi-patch-1

Browse Source 
Revise GPU/CPU memory footprint information
This commit is contained in:
ZiWei Yuan
2025-11-05 12:23:28 +08:00
committed by GitHub
parent 95814c72b2 6721f8765d
commit 8192cc4166
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
doc/en/KTransformers-Fine-Tuning_User-Guide.md
View File

@@ -284,8 +284,8 @@ chunk_size: 8192
### GPU/CPU Memory Footprint
- DeepSeek-V3 (671B; 61 layers with 58 MoE): ~**70 GB** total GPU memory (multi-GPU), ~**1.2–1.3 TB** host memory.
- DeepSeek-V2-Lite (14B; 27 layers with 26 MoE): ~**5.5 GB** GPU memory, ~**150 GB** host memory.
- DeepSeek-V3 (671B; 61 layers with 58 MoE): ~**70 GB** total GPU VRAM (multi-GPU), ~**1.2–1.3 TB** CPU RAM.
- DeepSeek-V2-Lite (14B; 27 layers with 26 MoE): ~**5.5 GB** GPU VRAM, ~**30 GB** CPU RAM.
## Conclusion