mirror of
https://github.com/deepseek-ai/DeepSeek-LLM.git
synced 2026-11-05 00:57:25 +00:00
[GH-ISSUE #18] question on "Revisit Multi-Choice Question Benchmarks" #11
Labels
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-LLM#11
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @imhmhm on GitHub (Dec 6, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/18
Thanks so much for sharing the findings and insights about "Multi-Choice Question Benchmarks", I have a quick question about the 20 million Chinese MC data leading to overfiting without generalizing to other tasks, are the data composed of questions with pure options OR with sort of explanations in the answers?
Thank you again for your great work!
@DeepSeekPH commented on GitHub (Dec 6, 2023):
Pure options