deepseek-ai/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2026-11-05 00:47:42 +00:00
Code Issues 45 Projects Packages Wiki Activity

[GH-ISSUE #264] 请求官方出一个 4bit的量化版本，并附带模型的效果指标 #196

New issue
Closed
opened 2026-10-26 21:16:39 +00:00 by bsakaguchi · 3 comments
bsakaguchi commented 2026-10-26 21:16:39 +00:00
Owner
Copy link

Originally created by @qiangruoyu on GitHub (Feb 5, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/264

希望能有一个4bit的官方量化版本。第三方量化都是没有详细的指标参数，即使使用了也不确信是否有严重掉点。
有了4bit的量化单个8卡的节点就能直接部署了。

Originally created by @qiangruoyu on GitHub (Feb 5, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/264 希望能有一个4bit的官方量化版本。第三方量化都是没有详细的指标参数，即使使用了也不确信是否有严重掉点。 有了4bit的量化单个8卡的节点就能直接部署了。
bsakaguchi 2026-10-26 21:16:39 +00:00
bsakaguchi commented 2026-10-26 21:16:40 +00:00
Author
Owner
Copy link

@Charmnut commented on GitHub (Feb 6, 2025):

the same issue.

<!-- gh-comment-id:2638898300 --> @Charmnut commented on GitHub (Feb 6, 2025): the same issue.
bsakaguchi commented 2026-10-26 21:16:40 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Mar 31, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2764821608 --> @github-actions[bot] commented on GitHub (Mar 31, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
bsakaguchi commented 2026-10-26 21:16:41 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (May 7, 2025):

false

<!-- gh-comment-id:2856617505 --> @github-actions[bot] commented on GitHub (May 7, 2025): false
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
v1.0.0
Labels
Clear labels   
bug

   
closed-as-stale

   
closed-as-stale

   
enhancement

   
pull-request
Mirrored from GitHub Pull Request

  
stale

   
stale
No labels
bug
closed-as-stale
closed-as-stale
enhancement
pull-request
stale
stale
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#196
No description provided.