[GH-ISSUE #496] 复现能成功跑起来,但是回答乱码,是我安装配置有问题吗 #353

Closed
opened 2026-10-29 14:38:22 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @xiamu-ya on GitHub (Feb 19, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/496

配置:
ktransformer版本:0.2.1+cu121torch23avx2
torch版本:2.3.0
跑的效果:
能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有

Image

运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M

Originally created by @xiamu-ya on GitHub (Feb 19, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/496 配置: ktransformer版本:0.2.1+cu121torch23avx2 torch版本:2.3.0 跑的效果: 能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有 ![Image](https://github.com/user-attachments/assets/d48b4c3e-e673-4dad-a8ff-a819c69562d6) 运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M
bsakaguchi 2026-10-29 14:38:22 +00:00
  • closed this issue
  • added the
    stale
    label
Author
Owner

@ruifenggong commented on GitHub (Feb 19, 2025):

配置: ktransformer版本:0.2.1+cu121torch23avx2 torch版本:2.3.0 跑的效果: 能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有

Image

运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M

DeepSeek-R1-UD-IQ1_M这个模型还没被支持,要用q_4_m

<!-- gh-comment-id:2667894770 --> @ruifenggong commented on GitHub (Feb 19, 2025): > 配置: ktransformer版本:0.2.1+cu121torch23avx2 torch版本:2.3.0 跑的效果: 能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有 > > ![Image](https://github.com/user-attachments/assets/d48b4c3e-e673-4dad-a8ff-a819c69562d6) > > 运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M DeepSeek-R1-UD-IQ1_M这个模型还没被支持,要用q_4_m
Author
Owner

@GaryWang1994 commented on GitHub (Feb 19, 2025):

配置: ktransformer版本:0.2.1+cu121torch23avx2 torch版本:2.3.0 跑的效果: 能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有
Image
运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M

DeepSeek-R1-UD-IQ1_M这个模型还没被支持,要用q_4_m

目前只能用Q_4_M么,我还在尝试部署DeepSeek-R1-UD-IQ1_S,因为我的电脑只有128G内存和10G显存,太大了跑不起来

<!-- gh-comment-id:2668970479 --> @GaryWang1994 commented on GitHub (Feb 19, 2025): > > 配置: ktransformer版本:0.2.1+cu121torch23avx2 torch版本:2.3.0 跑的效果: 能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有 > > ![Image](https://github.com/user-attachments/assets/d48b4c3e-e673-4dad-a8ff-a819c69562d6) > > 运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M > > DeepSeek-R1-UD-IQ1_M这个模型还没被支持,要用q_4_m 目前只能用Q_4_M么,我还在尝试部署DeepSeek-R1-UD-IQ1_S,因为我的电脑只有128G内存和10G显存,太大了跑不起来
Author
Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!


此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献!

<!-- gh-comment-id:3639958765 --> @ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。 如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。 感谢您对 KTransformers 的贡献!
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#353
No description provided.