[GH-ISSUE #297] Table4中IF-Eval的结果有误? #227

Closed
opened 2026-10-26 21:17:16 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @sz128 on GitHub (Feb 6, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/297

原文表述:DeepSeek-R1 also delivers impressive results on IF-Eval, a benchmark designed to assess a model’s ability to follow format instructions. These improvements can be linked to the inclusion of instruction-following data during the final stages of supervised fine-tuning (SFT) and RL training.

但是 table 4 中 IF-Eval 结果 是 R1比V3差呀。

Originally created by @sz128 on GitHub (Feb 6, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/297 原文表述:`DeepSeek-R1 also delivers impressive results on IF-Eval, a benchmark designed to assess a model’s ability to follow format instructions. These improvements can be linked to the inclusion of instruction-following data during the final stages of supervised fine-tuning (SFT) and RL training.` 但是 table 4 中 IF-Eval 结果 是 R1比V3差呀。
bsakaguchi 2026-10-26 21:17:16 +00:00
Author
Owner

@sz128 commented on GitHub (Feb 8, 2025):

@stack-heap-overflow

<!-- gh-comment-id:2644477966 --> @sz128 commented on GitHub (Feb 8, 2025): @stack-heap-overflow
Author
Owner

@yanghao1126 commented on GitHub (Mar 10, 2025):

好像是有这个问题

<!-- gh-comment-id:2711180071 --> @yanghao1126 commented on GitHub (Mar 10, 2025): 好像是有这个问题
Author
Owner

@github-actions[bot] commented on GitHub (May 5, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2849603635 --> @github-actions[bot] commented on GitHub (May 5, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (May 31, 2025):

false

<!-- gh-comment-id:2923763465 --> @github-actions[bot] commented on GitHub (May 31, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#227
No description provided.