[GH-ISSUE #105] 文章R1-zero实验评测部分图2 DeepSeek R1-Zero AIME Accuracy during training中,cons@16是否有误 #90

Closed
opened 2026-10-26 21:13:39 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @CarolineWinter88 on GitHub (Jan 28, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/105

Image
文章R1-zero实验评测部分图2 DeepSeek R1-Zero AIME Accuracy during training中,cons@16是否有误,我看表2这里和openai o1的整体对比实验都是都是描述的cons@64标准,图2中显示的openai o1-0912-cons@64 而R1-zero对应写的cons@16测试标准,不应该也是cons64吗

Originally created by @CarolineWinter88 on GitHub (Jan 28, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/105 ![Image](https://github.com/user-attachments/assets/dad926e0-3707-4a6b-b341-7c1fbd9e3f54) 文章R1-zero实验评测部分图2 DeepSeek R1-Zero AIME Accuracy during training中,cons@16是否有误,我看表2这里和openai o1的整体对比实验都是都是描述的cons@64标准,图2中显示的openai o1-0912-cons@64 而R1-zero对应写的cons@16测试标准,不应该也是cons64吗
bsakaguchi 2026-10-26 21:13:39 +00:00
Author
Owner

@Jiadalee commented on GitHub (Jan 28, 2025):

that is really a good catch

<!-- gh-comment-id:2619487922 --> @Jiadalee commented on GitHub (Jan 28, 2025): that is really a good catch
Author
Owner

@github-actions[bot] commented on GitHub (Mar 2, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2692480561 --> @github-actions[bot] commented on GitHub (Mar 2, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Apr 10, 2025):

false

<!-- gh-comment-id:2791234095 --> @github-actions[bot] commented on GitHub (Apr 10, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#90
No description provided.