[GH-ISSUE #780] 只有<think>和</think>包含的内容,没有额外输出 #566

Closed
opened 2026-10-29 14:41:16 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @Tyotw on GitHub (Mar 3, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/780

I use python -m ktransformers.local_chat --model_path /home/liuzhf/deepseek-ai/DeepSeek-V2-Lite-Chat --gguf_path /home/liuzhf/deepseek-ai/DeepSeek-V2-Lite-Chat-GGUF --port 7992 --force_think True --max_new_tokens 8192, but I got response inly in ..., then it ends, Why?

Image

Originally created by @Tyotw on GitHub (Mar 3, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/780 I use python -m ktransformers.local_chat --model_path /home/liuzhf/deepseek-ai/DeepSeek-V2-Lite-Chat --gguf_path /home/liuzhf/deepseek-ai/DeepSeek-V2-Lite-Chat-GGUF --port 7992 --force_think True --max_new_tokens 8192, but I got response inly in <think>...</think>, then it ends, Why? ![Image](https://github.com/user-attachments/assets/d85e6ea1-9ce7-4e50-b2d7-7cb156437ec6)
Author
Owner

@chenht2022 commented on GitHub (Mar 3, 2025):

V2没有reasoning能力,--force_think True 只有Deepseek-R1能用

<!-- gh-comment-id:2694347638 --> @chenht2022 commented on GitHub (Mar 3, 2025): V2没有reasoning能力,--force_think True 只有Deepseek-R1能用
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#566
No description provided.