[GH-ISSUE #2] inference tools like vllm can support? #2

Closed
opened 2026-10-26 21:01:29 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @zhang001122 on GitHub (Jan 11, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/2

as i mentioned , deepseek-moe is supported by vllm now ?

Originally created by @zhang001122 on GitHub (Jan 11, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/2 as i mentioned , deepseek-moe is supported by vllm now ?
Author
Owner

@Xingxiangrui commented on GitHub (Jan 11, 2024):

+1 for this

<!-- gh-comment-id:1886602167 --> @Xingxiangrui commented on GitHub (Jan 11, 2024): +1 for this
Author
Owner

@luofuli commented on GitHub (Jan 12, 2024):

We will soon support vllm inference

<!-- gh-comment-id:1888529787 --> @luofuli commented on GitHub (Jan 12, 2024): We will soon support vllm inference
Author
Owner

@zwd003 commented on GitHub (Jan 16, 2024):

we have add a support for vllm here https://github.com/vllm-project/vllm/pull/2453

<!-- gh-comment-id:1893595447 --> @zwd003 commented on GitHub (Jan 16, 2024): we have add a support for vllm here https://github.com/vllm-project/vllm/pull/2453
Sign in to join this conversation.
No labels
pull-request
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-MoE#2
No description provided.