[GH-ISSUE #41] Deepseek SFT数据包含system应该如何处理? #26

Closed
opened 2026-10-26 21:01:49 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @xiatingyu on GitHub (Feb 29, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/41

你好,请问如果我的SFT数据里面有system,那么我的模型输入应该是什么样的呢?
我用的LLama_factory做Deepseek的SFT,模型input是这样的:

<|begin▁of▁sentence|>You are a helpful assistant.User: Query

Assistant: RESPONSE<|end▁of▁sentence|>User: Query

Assistant: RESPONSE<|end▁of▁sentence|>

不知道这样处理system是否合适?

Originally created by @xiatingyu on GitHub (Feb 29, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/41 你好,请问如果我的SFT数据里面有system,那么我的模型输入应该是什么样的呢? 我用的LLama_factory做Deepseek的SFT,模型input是这样的: ``` <|begin▁of▁sentence|>You are a helpful assistant.User: Query Assistant: RESPONSE<|end▁of▁sentence|>User: Query Assistant: RESPONSE<|end▁of▁sentence|> ``` 不知道这样处理system是否合适?
Author
Owner

@DeepSeekPH commented on GitHub (Mar 4, 2024):

你的处理方式没问题

<!-- gh-comment-id:1976125009 --> @DeepSeekPH commented on GitHub (Mar 4, 2024): 你的处理方式没问题
Sign in to join this conversation.
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-LLM#26
No description provided.