[GH-ISSUE #21] the inference is very slow #16

Open
opened 2026-10-26 21:10:17 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @LCorleone on GitHub (Dec 25, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/21

Hi all, when I try deepseek vl2 model at one A800 card, the inference time is about 3-4 minutes, is it correct?

Originally created by @LCorleone on GitHub (Dec 25, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/21 Hi all, when I try deepseek vl2 model at one A800 card, the inference time is about 3-4 minutes, is it correct?
Author
Owner

@charlesCXK commented on GitHub (Dec 28, 2024):

The inference time at one A800 card should be in seconds.

<!-- gh-comment-id:2564212328 --> @charlesCXK commented on GitHub (Dec 28, 2024): The inference time at one A800 card should be in seconds.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL2#16
No description provided.