kvcache-ai/ktransformers
1
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-20 14:29:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update optimize_config_path for NPU tutorial

Browse Source
This commit is contained in:
RICHARDNAN
2025-10-29 10:47:44 +08:00
committed by GitHub
parent bb14f7594e
commit 6b68fc68d2
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
doc/zh/DeepseekR1_tutorial_zh_for_Ascend_NPU.md
View File

@@ -143,7 +143,7 @@ python ktransformers/server/main.py \
--gguf_path <your model path> \
--model_name DeepSeekV3ForCausalLM \
--cpu_infer 100 \
--optimize_config_path ./ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-300IA2-npu-serve.yaml \
--optimize_config_path ./ktransformers/optimize/optimize_rules/npu/DeepSeek-V3-Chat-300IA2-npu-serve.yaml \
--max_new_tokens 1024 \
--cache_lens 20480 \
--max_batch_size 4 \