mirror of
https://github.com/deepseek-ai/DeepSeek-R1.git
synced 2026-11-05 00:47:42 +00:00
[GH-ISSUE #505] sft cause repeat sentence issue #402
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-R1#402
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Auyin111 on GitHub (Feb 26, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/505
After I used llama factory to sft the 14b distilled qwen model using personal dataset, the model repeat same sentence again and again for a long time.
My training dataset format is xxx answer and has 380 training dataset.
Any idea on it? Thanks
@MSS444 commented on GitHub (Mar 18, 2025):
did you get an answer if yes then please tell i got a similar pattern on phi4 as well, i also used llamafactory
@github-actions[bot] commented on GitHub (Apr 19, 2025):
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
@github-actions[bot] commented on GitHub (May 23, 2025):
false