[GH-ISSUE #57] may A40 run tiny model? #41

Open
opened 2026-10-26 21:10:42 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @chiwuyin on GitHub (Feb 6, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/57

nvidia a40能运行tiny模型么,资源是否足够?

Originally created by @chiwuyin on GitHub (Feb 6, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL2/issues/57 nvidia a40能运行tiny模型么,资源是否足够?
Author
Owner

@HubHop commented on GitHub (Feb 6, 2025):

Yes. 48 GB is enough to host the tiny model (3B parameters).

<!-- gh-comment-id:2640010865 --> @HubHop commented on GitHub (Feb 6, 2025): Yes. 48 GB is enough to host the tiny model (3B parameters).
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL2#41
No description provided.