[GH-ISSUE #102] Verify evals on Papers with Code #81

Open
opened 2026-10-26 21:02:26 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @NielsRogge on GitHub (Sep 14, 2026).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/102

Hi,

Niels here from the open-source team at Hugging Face. Congratulations on your work!

I've made the paper and 18 paper-native evaluations available on Papers with Code.

The paper has results on Reasoning, World Knowledge, Coding Agents, and 3 additional task pages.

Would it be possible to verify these results and let me know if any score, model name, benchmark protocol, or openness metadata should be corrected?

You can also edit the task, methods, project page, and GitHub URL directly from the paper page using your Hugging Face account.

Kind regards,

Niels

Originally created by @NielsRogge on GitHub (Sep 14, 2026). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/102 Hi, Niels here from the open-source team at Hugging Face. Congratulations on your work! I've made the [paper](https://paperswithcode.co/paper/2401.02954) and [18 paper-native evaluations](https://paperswithcode.co/paper/2401.02954#results) available on Papers with Code. The paper has results on [Reasoning](https://paperswithcode.co/tasks/reasoning), [World Knowledge](https://paperswithcode.co/tasks/world-knowledge), [Coding Agents](https://paperswithcode.co/tasks/coding-agents), and 3 additional task pages. Would it be possible to verify these results and let me know if any score, model name, benchmark protocol, or openness metadata should be corrected? You can also edit the task, methods, project page, and GitHub URL directly from the paper page using your Hugging Face account. Kind regards, Niels
Author
Owner

@fengyinws commented on GitHub (Sep 14, 2026):

Hello,Your email has been received and I will process it as soon as possible!Best wishes!

<!-- gh-comment-id:5664870273 --> @fengyinws commented on GitHub (Sep 14, 2026): Hello,Your email has been received and I will process it as soon as possible!Best wishes!
Sign in to join this conversation.
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-LLM#81
No description provided.