[GH-ISSUE #675] DeepSeek-R1-0528 模型使用的评测框架是什么? #549

Closed
opened 2026-10-26 21:23:00 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @lzpp2598 on GitHub (Jun 5, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/675

看了 DeepSeek-R1-0528 模型的huggingface主页和 DeepSeek-R1 的技术报告,但是发现其中并未提及评测所使用的具体框架(例如 EvalScope 或 OpenCompass)。想请问官方在进行模型评测时是否采用了相关评测框架?如果有使用的话,具体使用的是什么框架呢?

Originally created by @lzpp2598 on GitHub (Jun 5, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/675 看了 DeepSeek-R1-0528 模型的huggingface主页和 DeepSeek-R1 的技术报告,但是发现其中并未提及评测所使用的具体框架(例如 EvalScope 或 OpenCompass)。想请问官方在进行模型评测时是否采用了相关评测框架?如果有使用的话,具体使用的是什么框架呢?
bsakaguchi 2026-10-26 21:23:00 +00:00
Author
Owner

@github-actions[bot] commented on GitHub (Jul 7, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:3043162663 --> @github-actions[bot] commented on GitHub (Jul 7, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Jul 23, 2025):

false

<!-- gh-comment-id:3105206117 --> @github-actions[bot] commented on GitHub (Jul 23, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#549
No description provided.