mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #496] 复现能成功跑起来,但是回答乱码,是我安装配置有问题吗 #353
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#353
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @xiamu-ya on GitHub (Feb 19, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/496
配置:
ktransformer版本:0.2.1+cu121torch23avx2
torch版本:2.3.0
跑的效果:
能跑,在载入CPU和GPU等待后,到Chat界面,但是无论我问中文还是英文问题,都是乱码,各种语言都有
运行命令:python -m ktransformers.local_chat --model_path ./DeepSeek-R1/ --gguf_path ./DeepSeek-R1-UD-IQ1_M
@ruifenggong commented on GitHub (Feb 19, 2025):
DeepSeek-R1-UD-IQ1_M这个模型还没被支持,要用q_4_m
@GaryWang1994 commented on GitHub (Feb 19, 2025):
目前只能用Q_4_M么,我还在尝试部署DeepSeek-R1-UD-IQ1_S,因为我的电脑只有128G内存和10G显存,太大了跑不起来
@ErvinXie commented on GitHub (Dec 11, 2025):
This issue has been automatically closed due to inactivity for 60 days.
If you believe this issue is still relevant, please feel free to reopen it with additional information or context.
Thank you for your contribution to KTransformers!
此 issue 因超过 60 天无活动而被自动关闭。
如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。
感谢您对 KTransformers 的贡献!