[GH-ISSUE #71] qwen32B蒸馏模型,长度>8k时,预测一定比例乱码,出现<think><think><think><think><think><think> #60

Closed
opened 2026-10-26 21:12:39 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @daniellibin on GitHub (Jan 25, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/71

temperature按照0.6设置的,大家遇到过这个情况吗?
长度设置4k以内无乱码但是会截断;
长度设置8k以上大概有20%比例出现,一直重复输出

Originally created by @daniellibin on GitHub (Jan 25, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/71 temperature按照0.6设置的,大家遇到过这个情况吗? 长度设置4k以内无乱码但是会截断; 长度设置8k以上大概有20%比例出现,一直重复输出
Author
Owner

@stack-heap-overflow commented on GitHub (Jan 26, 2025):

https://huggingface.co/deepseek-ai/DeepSeek-R1/discussions/44

<!-- gh-comment-id:2614277400 --> @stack-heap-overflow commented on GitHub (Jan 26, 2025): https://huggingface.co/deepseek-ai/DeepSeek-R1/discussions/44
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#60
No description provided.