[GH-ISSUE #330] 并发数超过100的,一般采用什么工具部署呢 #257

Closed
opened 2026-10-26 21:18:02 +00:00 by bsakaguchi · 5 comments
Owner

Originally created by @wxzwxz131 on GitHub (Feb 8, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/330

如题所示,用ollama和vllm是不是就很难支持了

Originally created by @wxzwxz131 on GitHub (Feb 8, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/330 如题所示,用ollama和vllm是不是就很难支持了
bsakaguchi 2026-10-26 21:18:02 +00:00
Author
Owner

@deepsicker commented on GitHub (Feb 8, 2025):

跟部署工具没关系 ,是你有没有足够的的显卡。 ollama 只一个部署大模型的工具。 它做了多卡并行计算的功能!

<!-- gh-comment-id:2644556870 --> @deepsicker commented on GitHub (Feb 8, 2025): 跟部署工具没关系 ,是你有没有足够的的显卡。 ollama 只一个部署大模型的工具。 它做了多卡并行计算的功能!
Author
Owner

@Kenwwww commented on GitHub (Feb 10, 2025):

vllm部署多路+nginx多路转发

<!-- gh-comment-id:2646715066 --> @Kenwwww commented on GitHub (Feb 10, 2025): vllm部署多路+nginx多路转发
Author
Owner

@Single430 commented on GitHub (Feb 15, 2025):

最好大的办法是多卡多机+负载均衡

<!-- gh-comment-id:2660725416 --> @Single430 commented on GitHub (Feb 15, 2025): 最好大的办法是多卡多机+负载均衡
Author
Owner

@github-actions[bot] commented on GitHub (Mar 27, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2756038387 --> @github-actions[bot] commented on GitHub (Mar 27, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (May 2, 2025):

false

<!-- gh-comment-id:2846037329 --> @github-actions[bot] commented on GitHub (May 2, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#257
No description provided.