[GH-ISSUE #354] 请问下,部署BF16和FP8的deepseek v3,分别需要多少显存 #276

Closed
opened 2026-10-26 21:18:38 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @liguoyu666 on GitHub (Feb 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/354

准备用80G的A100,先计算下要多少张显卡

Originally created by @liguoyu666 on GitHub (Feb 10, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/354 准备用80G的A100,先计算下要多少张显卡
Author
Owner

@wingjson commented on GitHub (Feb 13, 2025):

fp8大概800-1200吧。bf16至少1.4t,A100不支持fp8。得用bf16

<!-- gh-comment-id:2655334966 --> @wingjson commented on GitHub (Feb 13, 2025): fp8大概800-1200吧。bf16至少1.4t,A100不支持fp8。得用bf16
Author
Owner

@liguoyu666 commented on GitHub (Feb 13, 2025):

fp8大概800-1200吧。bf16至少1.4t,A100不支持fp8。得用bf16

谢谢

<!-- gh-comment-id:2655373821 --> @liguoyu666 commented on GitHub (Feb 13, 2025): > fp8大概800-1200吧。bf16至少1.4t,A100不支持fp8。得用bf16 谢谢
Author
Owner

@sweetspace2024 commented on GitHub (Feb 14, 2025):

准备用80G的A100,先计算下要多少张显卡

A100不支持FP8啊

<!-- gh-comment-id:2659173678 --> @sweetspace2024 commented on GitHub (Feb 14, 2025): > 准备用80G的A100,先计算下要多少张显卡 A100不支持FP8啊
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#276
No description provided.