deepseek-ai/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2026-11-05 00:47:42 +00:00
Code Issues 45 Projects Packages Wiki Activity

[GH-ISSUE #677] 关于在aime24与25任务上的评估方法 #550

New issue
Closed
opened 2026-10-26 21:23:03 +00:00 by bsakaguchi · 2 comments
bsakaguchi commented 2026-10-26 21:23:03 +00:00
Owner
Copy link

Originally created by @Violettttee on GitHub (Jun 9, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/677

可以请问下r1-0528-distill-qwen-8b的模型的评估也是生成16次后取的平均分嘛？

其次想请问下在aime任务上推理时会有额外的system prompt之类的嘛？因为看到题目并没有输出格式的限制，想知道是直接按照原题的question来做的生成吗？

Originally created by @Violettttee on GitHub (Jun 9, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/677 可以请问下r1-0528-distill-qwen-8b的模型的评估也是生成16次后取的平均分嘛？ 其次想请问下在aime任务上推理时会有额外的system prompt之类的嘛？因为看到题目并没有输出格式的限制，想知道是直接按照原题的question来做的生成吗？
bsakaguchi 2026-10-26 21:23:03 +00:00
bsakaguchi commented 2026-10-26 21:23:04 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Jul 11, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:3059636399 --> @github-actions[bot] commented on GitHub (Jul 11, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
bsakaguchi commented 2026-10-26 21:23:04 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Jul 26, 2025):

false

<!-- gh-comment-id:3120750084 --> @github-actions[bot] commented on GitHub (Jul 26, 2025): false
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
v1.0.0
Labels
Clear labels   
bug

   
closed-as-stale

   
closed-as-stale

   
enhancement

   
pull-request
Mirrored from GitHub Pull Request

  
stale

   
stale
No labels
bug
closed-as-stale
closed-as-stale
enhancement
pull-request
stale
stale
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#550
No description provided.