[GH-ISSUE #44] docker for vllm. with deepseekv2 support merged #43

Open
opened 2026-10-26 21:07:10 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @supdizh on GitHub (May 27, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/44

https://hub.docker.com/r/superdizh891/vllm042-dsv2
build a docker of vllm with https://github.com/vllm-project/vllm/pull/4650 merged

hope deepseek's PR could get merged, quite a pain to compile vllm for it

Originally created by @supdizh on GitHub (May 27, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/44 https://hub.docker.com/r/superdizh891/vllm042-dsv2 build a docker of vllm with https://github.com/vllm-project/vllm/pull/4650 merged hope deepseek's PR could get merged, quite a pain to compile vllm for it
Author
Owner

@wulaoshi commented on GitHub (Oct 29, 2024):

u r my hero!

<!-- gh-comment-id:2443028107 --> @wulaoshi commented on GitHub (Oct 29, 2024): u r my hero!
Author
Owner

@supdizh commented on GitHub (Oct 29, 2024):

u r my hero!
诶?大概2个月前 DS支持已经被vllm合入了哈,0.41 还是0.42就有了,可以用官方的

<!-- gh-comment-id:2443070092 --> @supdizh commented on GitHub (Oct 29, 2024): > u r my hero! 诶?大概2个月前 DS支持已经被vllm合入了哈,0.41 还是0.42就有了,可以用官方的
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-V2#43
No description provided.