[GH-ISSUE #618] 长文本知识库任务中,只输出思考过程且内容与给定文本提示词无关 #500

Closed
opened 2026-10-26 21:22:17 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @frankSARU on GitHub (Apr 8, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/618

使用知识库框架调用deepseek R1全量版,采用prefix的形式给定提示词和上传的文档内容,得到类似下图结果

Image

文档内容与其输出的内容没有关系,且每次思考内容都不一样,最终思考内容输出完毕后,会直接停止输出正式回答。

同样的应用架构,切换调用QwQ 32B、Qwen蒸馏版32B,其中QwQ能正确理解意图和输出内容,蒸馏版deepseek能正确理解意图,但是输出内容错误较多。

文本量大概在3万tokens左右。采用vllm部署,开启张量并行,2节点共16卡H20服务器运行部署。

Originally created by @frankSARU on GitHub (Apr 8, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/618 使用知识库框架调用deepseek R1全量版,采用prefix的形式给定提示词和上传的文档内容,得到类似下图结果 ![Image](https://github.com/user-attachments/assets/3a1a212e-b65e-48f0-972b-2c6a3f467309) 文档内容与其输出的内容没有关系,且每次思考内容都不一样,最终思考内容输出完毕后,会直接停止输出正式回答。 同样的应用架构,切换调用QwQ 32B、Qwen蒸馏版32B,其中QwQ能正确理解意图和输出内容,蒸馏版deepseek能正确理解意图,但是输出内容错误较多。 文本量大概在3万tokens左右。采用vllm部署,开启张量并行,2节点共16卡H20服务器运行部署。
bsakaguchi 2026-10-26 21:22:17 +00:00
Author
Owner

@frankSARU commented on GitHub (Apr 8, 2025):

重启模型后,还有可能出现,意图理解和输出正确,但是思考过程不完整且为prefix提示词的情况,如下图

Image

部署平台是xinference

<!-- gh-comment-id:2786167726 --> @frankSARU commented on GitHub (Apr 8, 2025): 重启模型后,还有可能出现,意图理解和输出正确,但是思考过程不完整且为prefix提示词的情况,如下图 ![Image](https://github.com/user-attachments/assets/8fcb2a1b-4366-4fc3-9ae9-0a8a1da31597) 部署平台是xinference
Author
Owner

@github-actions[bot] commented on GitHub (May 11, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2869264518 --> @github-actions[bot] commented on GitHub (May 11, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Jun 5, 2025):

false

<!-- gh-comment-id:2942094956 --> @github-actions[bot] commented on GitHub (Jun 5, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#500
No description provided.