deepseek-ai/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2026-11-05 00:47:42 +00:00
Code Issues 45 Projects Packages Wiki Activity

[GH-ISSUE #678] r1-0528-distill-qwen-8b在AIME24上的性能 #551

New issue
Closed
opened 2026-10-26 21:23:03 +00:00 by bsakaguchi · 2 comments
bsakaguchi commented 2026-10-26 21:23:03 +00:00
Owner
Copy link

Originally created by @yin-zhang on GitHub (Jun 9, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/678

我们和好几个其他团队的小伙伴, 在复现r1-0528-distill-qwen-8b性能时都遇到了问题. 不论用deepscaler, 还是用llamafactory评估, 最后的得分都比官方的得分低4-5分. 大佬们能否提供一下评估模型的一些细节啊? 比如超参数, system prompt, user prompt等等.

4-5分的差距太大了, 肯定不是偶然. 还希望大佬们可以帮忙指点指点.

Originally created by @yin-zhang on GitHub (Jun 9, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/678 我们和好几个其他团队的小伙伴, 在复现r1-0528-distill-qwen-8b性能时都遇到了问题. 不论用deepscaler, 还是用llamafactory评估, 最后的得分都比官方的得分低4-5分. 大佬们能否提供一下评估模型的一些细节啊? 比如超参数, system prompt, user prompt等等. 4-5分的差距太大了, 肯定不是偶然. 还希望大佬们可以帮忙指点指点.
bsakaguchi 2026-10-26 21:23:03 +00:00
bsakaguchi commented 2026-10-26 21:23:04 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Jul 16, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:3076287140 --> @github-actions[bot] commented on GitHub (Jul 16, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
bsakaguchi commented 2026-10-26 21:23:04 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Jul 31, 2025):

false

<!-- gh-comment-id:3138191260 --> @github-actions[bot] commented on GitHub (Jul 31, 2025): false
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
v1.0.0
Labels
Clear labels   
bug

   
closed-as-stale

   
closed-as-stale

   
enhancement

   
pull-request
Mirrored from GitHub Pull Request

  
stale

   
stale
No labels
bug
closed-as-stale
closed-as-stale
enhancement
pull-request
stale
stale
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#551
No description provided.