mirror of
https://github.com/deepseek-ai/DeepSeek-R1.git
synced 2026-11-05 00:47:42 +00:00
[GH-ISSUE #354] 请问下,部署BF16和FP8的deepseek v3,分别需要多少显存 #276
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-R1#276
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @liguoyu666 on GitHub (Feb 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/354
准备用80G的A100,先计算下要多少张显卡
@wingjson commented on GitHub (Feb 13, 2025):
fp8大概800-1200吧。bf16至少1.4t,A100不支持fp8。得用bf16
@liguoyu666 commented on GitHub (Feb 13, 2025):
谢谢
@sweetspace2024 commented on GitHub (Feb 14, 2025):
A100不支持FP8啊