mirror of
https://github.com/deepseek-ai/DeepSeek-MoE.git
synced 2026-11-05 00:57:43 +00:00
[GH-ISSUE #2] inference tools like vllm can support? #2
Labels
No labels
pull-request
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-MoE#2
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @zhang001122 on GitHub (Jan 11, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/2
as i mentioned , deepseek-moe is supported by vllm now ?
@Xingxiangrui commented on GitHub (Jan 11, 2024):
+1 for this
@luofuli commented on GitHub (Jan 12, 2024):
We will soon support vllm inference
@zwd003 commented on GitHub (Jan 16, 2024):
we have add a support for vllm here https://github.com/vllm-project/vllm/pull/2453