[GH-ISSUE #414] AttributeError: 'KDeepseekV2Attention' object has no attribute 'q_lora_rank' #281

New issue

Closed

opened 2026-10-29 14:37:15 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-29 14:37:15 +00:00

Owner

Originally created by @AndrewBoom on GitHub (Feb 17, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/414

配置:deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
模型:unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF
执行的指令python3 -m ktransformers.local_chat ./DeepSeek-R1-Distill-Qwen-32B --gguf_path ./DeepSeek-R1-Distill-Qwen-32B-GGUF --optimize_rule_path ./DeepSeek-V3-Chat.yaml
进入聊天界面发完消息报该错误

Originally created by @AndrewBoom on GitHub (Feb 17, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/414 配置:deepseek-ai/DeepSeek-R1-Distill-Qwen-32B 模型:unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF 执行的指令python3 -m ktransformers.local_chat ./DeepSeek-R1-Distill-Qwen-32B --gguf_path ./DeepSeek-R1-Distill-Qwen-32B-GGUF --optimize_rule_path ./DeepSeek-V3-Chat.yaml 进入聊天界面发完消息报该错误

bsakaguchi closed this issue

2026-10-29 14:37:15 +00:00

bsakaguchi commented

2026-10-29 14:37:15 +00:00

Author

Owner

@Azure-Tang commented on GitHub (Feb 17, 2025):

我们没有测试过qwen32b的模型，请查看我们的安装指南里支持的模型“supported models”

@Azure-Tang commented on GitHub (Feb 17, 2025): 我们没有测试过qwen32b的模型，请查看我们的安装指南里支持的模型“supported models”

bsakaguchi commented

2026-10-29 14:37:16 +00:00

Author

Owner

@caduke80 commented on GitHub (Feb 21, 2025):

AttributeError: 'Qwen2FlashAttention2' object has no attribute 'q_lora_rank'

@caduke80 commented on GitHub (Feb 21, 2025): AttributeError: 'Qwen2FlashAttention2' object has no attribute 'q_lora_rank'

bsakaguchi commented

2026-10-29 14:37:16 +00:00

Author

Owner

@tianyongliu commented on GitHub (Feb 21, 2025):

get the same error

@tianyongliu commented on GitHub (Feb 21, 2025): get the same error