mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #728] 本地部署deepseek 671B后，local chat能正常跑，但是网页版本打开响应出问题，有没有大佬遇到过的？ linux+docker部署 #533
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#533
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @tenyee on GitHub (Feb 28, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/728
启动命令：
ktransformers --gguf_path /workspace/models/DeepSeek-R1-Q4_K_M/ --model_path /workspace/models/DeepSeek-R1/DeepSeek-R1 --model_name deepseek-r1-671b --max_new_tokens 4096 --cpu_infer 65 --cache_lens 1536 --port 10012 --batch_size 5 --web True
运行截图：
@NNagatoYuki commented on GitHub (Feb 28, 2025):
版本r0.2.2rc1同样是这种情况，config.js配置里已经把url地址改为服务器地址，但是页面打开提交请求的地址依然是localhost
@tenyee commented on GitHub (Feb 28, 2025):
您好，邮件我已收到，我会尽快查看~~~谢谢~~
@qiyuxinlin commented on GitHub (Mar 2, 2025):
需要将端口映射到本地，通过 localchat 打开页面
@tenyee commented on GitHub (Mar 3, 2025):
放弃了，我采用open webui的方式接入了kt