mirror of
https://github.com/deepseek-ai/DeepSeek-R1.git
synced 2026-11-05 00:47:42 +00:00
[GH-ISSUE #330] 并发数超过100的,一般采用什么工具部署呢 #257
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-R1#257
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @wxzwxz131 on GitHub (Feb 8, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/330
如题所示,用ollama和vllm是不是就很难支持了
@deepsicker commented on GitHub (Feb 8, 2025):
跟部署工具没关系 ,是你有没有足够的的显卡。 ollama 只一个部署大模型的工具。 它做了多卡并行计算的功能!
@Kenwwww commented on GitHub (Feb 10, 2025):
vllm部署多路+nginx多路转发
@Single430 commented on GitHub (Feb 15, 2025):
最好大的办法是多卡多机+负载均衡
@github-actions[bot] commented on GitHub (Mar 27, 2025):
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
@github-actions[bot] commented on GitHub (May 2, 2025):
false