[GH-ISSUE #68] Broken tokenizer for Qwen-distill models? #57

Closed
opened 2026-10-26 21:12:28 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @OedoSoldier on GitHub (Jan 24, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/68

Someone has found it on huggingface: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B/discussions/4

It seems the tokenizer.json for Qwen models are broken.

Originally created by @OedoSoldier on GitHub (Jan 24, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/68 Someone has found it on huggingface: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B/discussions/4 It seems the `tokenizer.json` for Qwen models are broken.
bsakaguchi 2026-10-26 21:12:28 +00:00
Author
Owner

@github-actions[bot] commented on GitHub (Feb 24, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2677236637 --> @github-actions[bot] commented on GitHub (Feb 24, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Mar 15, 2025):

false

<!-- gh-comment-id:2726038955 --> @github-actions[bot] commented on GitHub (Mar 15, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#57
No description provided.