[GH-ISSUE #492] Fine-tune a DeepSeek distilled variant with a reasoning dataset #393

Closed
opened 2026-10-26 21:20:34 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @timo-kurtz on GitHub (Feb 24, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/492

I want to fine-tune a distilled variant with a reasoning dataset. My question is whether I should generate two responses (one for the reasoning and one for the actual answer separately) or combine both the reasoning and the final answer into a single response. Do you have any other suggestions?

deep_seek_prompt = """ <|User|>{}<|end▁of▁sentence|> <|Assistant|> {} <|end▁of▁sentence|> <|Assistant|>{}"""

or

deep_seek_prompt = """ <|User|>{}<|end▁of▁sentence|> <|Assistant|> {} {}"""

Originally created by @timo-kurtz on GitHub (Feb 24, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/492 I want to fine-tune a distilled variant with a reasoning dataset. My question is whether I should generate two responses (one for the reasoning and one for the actual answer separately) or combine both the reasoning and the final answer into a single response. Do you have any other suggestions? deep_seek_prompt = """ <|User|>{}<|end▁of▁sentence|> <|Assistant|> <think> {} </think><|end▁of▁sentence|> <|Assistant|>{}""" or deep_seek_prompt = """ <|User|>{}<|end▁of▁sentence|> <|Assistant|> <think> {} </think> {}"""
bsakaguchi 2026-10-26 21:20:34 +00:00
Author
Owner

@wangfengsec commented on GitHub (Feb 28, 2025):

mark

<!-- gh-comment-id:2690056796 --> @wangfengsec commented on GitHub (Feb 28, 2025): mark
Author
Owner

@github-actions[bot] commented on GitHub (Apr 20, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2816914484 --> @github-actions[bot] commented on GitHub (Apr 20, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (May 23, 2025):

false

<!-- gh-comment-id:2902917510 --> @github-actions[bot] commented on GitHub (May 23, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#393
No description provided.