mirror of
https://github.com/deepseek-ai/DeepSeek-V2.git
synced 2026-11-05 08:57:35 +00:00
[GH-ISSUE #59] 关于DeepSeek-Coder-V2-Lite-Base的128k捞针测试结果 #58
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-V2#58
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @chaochen99 on GitHub (Jun 21, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/59
您好，
我测试了deepseek-ai/DeepSeek-Coder-V2-Lite-Base 在128k捞针任务上的表现，结果的正确率不足50%。并且受限于硬件，我无法在deepseek-ai/DeepSeek-Coder-V2-Base 上进行1k到128k的捞针测试。
不知是DeepSeek-Coder-V2-Lite-Base的捞针任务表现一般还是我的测试代码有问题，您可否提供捞针测试代码以便于我重新测试？
感谢！
@hensiesp32 commented on GitHub (Jun 24, 2024):
您好，请问您在测试海底捞针的过程中，是否遇到过模型输出不达到max-new-token就不停止的情况呢？
类似于https://github.com/deepseek-ai/DeepSeek-V2/issues/60 这个问题。