[GH-ISSUE #1460] [Bug] 运行 KT 0.3.2 版本时出错,KeyError: 'disk_path' #971

Open
opened 2026-10-29 14:47:04 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @Z27-DSR1 on GitHub (Jul 28, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1460

检查清单

  • 1. 我已经搜索过相关问题,但未能获得预期的帮助
  • 2. 该问题在最新版本中尚未修复
  • 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性
  • 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭
  • 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭

问题描述

运行 KT 0.3.2 版本时出错,请帮忙看一下什么原因

复现步骤

(kt2) xstdsr1@xstdsr1-System-Product-Name:~/ktransformers$ python ktransformers/server/main.py \

--port 10002
--host 10.97.14.98
--model_path /home/xstdsr1/DeepSeek-R1
--gguf_path /home/xstdsr1/DeepSeek-R1-GGUF/DeepSeek-R1-UD-IQ1_S
--optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-serve.yaml
--max_new_tokens 1024
--cpu_infer 14
--cache_lens 32768
--chunk_size 256
--max_batch_size 4
--backend_type balance_serve
--use_cuda_graph
--force_think
Traceback (most recent call last):
File "/home/xstdsr1/ktransformers/ktransformers/server/main.py", line 10, in
from ktransformers.server.args import ArgumentParser
File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/args.py", line 2, in
from ktransformers.server.backend.args import ConfigArgs, default_args
File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/backend/args.py", line 79, in
cfg = Config()
^^^^^^^^
File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/config/singleton.py", line 26, in call
cls._instances[cls] = super(Singleton, cls).call(*args, **kwds)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/config/config.py", line 206, in init
self.kvc2_disk_path = cfg["kvc2"]["disk_path"]
~~~~~~~~~~~^^^^^^^^^^^^^
KeyError: 'disk_path'
(kt2) xstdsr1@xstdsr1-System-Product-Name:~/ktransformers$

环境信息

Version: 0.3.2+cu128torch27avx2
NVIDIA-SMI 570.169 Driver Version: 570.169 CUDA Version: 12.8
Ubuntu 2404
i9/192G内存/4090-24G

Originally created by @Z27-DSR1 on GitHub (Jul 28, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1460 ### 检查清单 - [ ] 1. 我已经搜索过相关问题,但未能获得预期的帮助 - [ ] 2. 该问题在最新版本中尚未修复 - [ ] 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性 - [ ] 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭 - [ ] 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭 ### 问题描述 运行 KT 0.3.2 版本时出错,请帮忙看一下什么原因 ### 复现步骤 (kt2) xstdsr1@xstdsr1-System-Product-Name:~/ktransformers$ python ktransformers/server/main.py \ > --port 10002 \ > --host 10.97.14.98 \ > --model_path /home/xstdsr1/DeepSeek-R1 \ > --gguf_path /home/xstdsr1/DeepSeek-R1-GGUF/DeepSeek-R1-UD-IQ1_S \ > --optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-serve.yaml \ > --max_new_tokens 1024 \ > --cpu_infer 14 \ > --cache_lens 32768 \ > --chunk_size 256 \ > --max_batch_size 4 \ > --backend_type balance_serve \ > --use_cuda_graph \ > --force_think Traceback (most recent call last): File "/home/xstdsr1/ktransformers/ktransformers/server/main.py", line 10, in <module> from ktransformers.server.args import ArgumentParser File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/args.py", line 2, in <module> from ktransformers.server.backend.args import ConfigArgs, default_args File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/backend/args.py", line 79, in <module> cfg = Config() ^^^^^^^^ File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/config/singleton.py", line 26, in __call__ cls._instances[cls] = super(Singleton, cls).__call__(*args, **kwds) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/xstdsr1/.conda/envs/kt2/lib/python3.11/site-packages/ktransformers/server/config/config.py", line 206, in __init__ self.kvc2_disk_path = cfg["kvc2"]["disk_path"] ~~~~~~~~~~~^^^^^^^^^^^^^ KeyError: 'disk_path' (kt2) xstdsr1@xstdsr1-System-Product-Name:~/ktransformers$ ### 环境信息 Version: 0.3.2+cu128torch27avx2 NVIDIA-SMI 570.169 Driver Version: 570.169 CUDA Version: 12.8 Ubuntu 2404 i9/192G内存/4090-24G
Author
Owner

@shinchou commented on GitHub (Jul 29, 2025):

1 目录权限问题, 尝试chmod
2 没有删除旧的~/.ktransformers目录, 就运行了新的0.3.2, 也会卡在这上面
3 sudo python ktransformers/server/main.py xxx

<!-- gh-comment-id:3132055718 --> @shinchou commented on GitHub (Jul 29, 2025): 1 目录权限问题, 尝试chmod 2 没有删除旧的~/.ktransformers目录, 就运行了新的0.3.2, 也会卡在这上面 3 sudo python ktransformers/server/main.py xxx
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#971
No description provided.