mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #488] 拜托，能不能重视一下windows加载r1，对话出错的问题，好多天都没解决了！ #343
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#343
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @newstargo on GitHub (Feb 19, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/488
启动：
python -m ktransformers.local_chat --model_path F:/DeepSeek-R1-Q4_K_M --gguf_path F:/DeepSeek-R1-Q4_K_M
错误提示：
异常内存与显存占用：
@woOzZ2 commented on GitHub (Feb 19, 2025):
同样问题
@xialang2012 commented on GitHub (Feb 19, 2025):
看到不少于20个同样反馈了
@wwqiu commented on GitHub (Feb 19, 2025):
开发人员估计要处理的问题太多了，这边建议您有时间的话可以自己提交PR 😜
@shuchong commented on GitHub (Feb 19, 2025):
python ./ktransformers/local_chat.py --model_path deepseek-ai/DeepSeek-R1 --gguf_path $HOME/WT/DeepSeek/DeepSeek-R1-GGUF/DeepSeek-R1-Q4_K_M/ --cpu_infer 32 --cache_lens 1536 试下其他成功了命令。
@newstargo commented on GitHub (Feb 20, 2025):
和命令无关，没见到WINDOWS跑R1成功的案例
@yeungtuzi commented on GitHub (Feb 20, 2025):
不要使用windows，现在这个开发状态，根本没工夫兼顾这么多平台，建议装个ubuntu 22.04 lts
@newstargo commented on GitHub (Feb 20, 2025):
这项目本身更适合个人或小范围应用，并发需求多并不是CPU+内存能满足使用强度和效率，windows应先行，毕竟商用离不开GPU，才是LUNIX为主
@ceerRep commented on GitHub (Feb 21, 2025):
建议先用WSL凑合。我感觉他们根本复现不了这个问题，因为大学里很少有装windows的服务器
@newstargo commented on GitHub (Feb 21, 2025):
理解了，这也许是开发团队的生态，只是要想在实际应用有更大的使用量，项目以目前的效率应先满足个人为主，毕竟要有10T以上的速度，双CPU+1T内存+3090起，2万+是能接受的，但并发等待是商业化不接受，也不是软件能解决的。这项目令人喜欢是硬件全调用，这点不是企业在意，是个人用户所爱，但GPU不是这项目的必要条件，所以希望他们能先做好个人用户，找出CPU+GPU尽用所能，再切入LINUX的商用。
@chenzin commented on GitHub (Mar 12, 2025):
为啥wsl都不试试
@yeungtuzi commented on GitHub (Mar 12, 2025):
我还是坚持老观点，不要使用windows来干任何AI相关的项目
发件人: chenzin @.>
发送时间: 2025年3月12日 14:00
收件人: kvcache-ai/ktransformers @.>
抄送: yeungtuzi @.>; Comment @.>
主题: Re: [kvcache-ai/ktransformers] 拜托，能不能重视一下windows加载r1，对话出错的问题，好多天都没解决了！ (Issue #488)
为啥wsl都不试试
―
Reply to this email directly, view it on GitHubhttps://github.com/kvcache-ai/ktransformers/issues/488#issuecomment-2716618518, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADLPPAGBAMUSAZB6ODJTXDL2T7EQRAVCNFSM6AAAAABXNHJBZCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMJWGYYTQNJRHA.
You are receiving this because you commented.Message ID: @.***>
[chenzin]chenzin left a comment (kvcache-ai/ktransformers#488)https://github.com/kvcache-ai/ktransformers/issues/488#issuecomment-2716618518
为啥wsl都不试试
―
Reply to this email directly, view it on GitHubhttps://github.com/kvcache-ai/ktransformers/issues/488#issuecomment-2716618518, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADLPPAGBAMUSAZB6ODJTXDL2T7EQRAVCNFSM6AAAAABXNHJBZCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMJWGYYTQNJRHA.
You are receiving this because you commented.Message ID: @.***>