[GH-ISSUE #192] Incorrect Sensitivity Filtering for Chinese Medical Queries & Inconsistent Model Version Responses #134

Closed
opened 2026-10-26 21:15:06 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @hogo-mini on GitHub (Jan 30, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/192

The current system mistakenly flags neutral medical questions (e.g., "子宫是什么"/"what is uterus") as sensitive in Chinese, while allowing identical English queries. Additionally, there are inconsistencies between model versions (R1 vs v3) in handling health-related advice like menstrual discomfort mitigation.

Issue 1: Overly Strict Chinese Sensitivity Filter
Reproduction Steps:

Query in English: what is uterus → DeepSeek provides a factual medical explanation.
Image

Query in Chinese: 子宫是什么 → System rejects it as "sensitive content."
Image

Expected Behavior:
Neutral anatomical/medical discussions in Chinese should not be blocked, mirroring the English response.

Issue 2: Inconsistent Model Version Performance
Example Query: 经期不适如何缓解 ("How to relieve menstrual discomfort")

R1 Model: Fails to provide actionable advice (or flags as sensitive).
Image

v3 Model: Responds appropriately with evidence-based suggestions.
Image

Request: Ensure all model versions handle health-related queries consistently (for content moderation).

Suggested Fixes:
Adjust the Chinese content filter to exclude non-sensitive medical terminology (e.g., uterus, menstruation).

Harmonize model version outputs for health advice queries.

Add context-aware differentiation between medical discussions and inappropriate content.

Additional Observation: Inconsistent Output Stability
Users report varying experiences with identical prompts:

  • Some receive complete answers successfully.
  • Others observe partial reasoning steps (visible "thinking process") that get abruptly truncated, ultimately displaying an error/unable to answer.
Originally created by @hogo-mini on GitHub (Jan 30, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/192 The current system mistakenly flags neutral medical questions (e.g., "子宫是什么"/"what is uterus") as sensitive in Chinese, while allowing identical English queries. Additionally, there are inconsistencies between model versions (R1 vs v3) in handling health-related advice like menstrual discomfort mitigation. **Issue 1: Overly Strict Chinese Sensitivity Filter** Reproduction Steps: Query in English: what is uterus → DeepSeek provides a factual medical explanation. ![Image](https://github.com/user-attachments/assets/1a1b2c7e-9bd7-4944-a785-4c231b9eac89) Query in Chinese: 子宫是什么 → System rejects it as "sensitive content." ![Image](https://github.com/user-attachments/assets/2c0b54f7-7789-4c4a-a7a9-a49b7780a3ca) Expected Behavior: Neutral anatomical/medical discussions in Chinese should not be blocked, mirroring the English response. **Issue 2: Inconsistent Model Version Performance** Example Query: 经期不适如何缓解 ("How to relieve menstrual discomfort") R1 Model: Fails to provide actionable advice (or flags as sensitive). ![Image](https://github.com/user-attachments/assets/0df8551b-fed6-4c32-9453-6f0e14ab5155) v3 Model: Responds appropriately with evidence-based suggestions. ![Image](https://github.com/user-attachments/assets/50eeff57-a887-4c30-acb9-19363bddfd47) Request: Ensure all model versions handle health-related queries consistently (for content moderation). **Suggested Fixes:** Adjust the Chinese content filter to exclude non-sensitive medical terminology (e.g., uterus, menstruation). Harmonize model version outputs for health advice queries. Add context-aware differentiation between medical discussions and inappropriate content. **Additional Observation: Inconsistent Output Stability** Users report varying experiences with identical prompts: * Some receive complete answers successfully. * Others observe partial reasoning steps (visible "thinking process") that get abruptly truncated, ultimately displaying an error/unable to answer.
bsakaguchi 2026-10-26 21:15:06 +00:00
Author
Owner

@MaGnus-Li commented on GitHub (Jan 31, 2025):

是的,这自我审查太严苛了。

<!-- gh-comment-id:2627337548 --> @MaGnus-Li commented on GitHub (Jan 31, 2025): 是的,这自我审查太严苛了。
Author
Owner

@github-actions[bot] commented on GitHub (Mar 11, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2712126002 --> @github-actions[bot] commented on GitHub (Mar 11, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@github-actions[bot] commented on GitHub (Apr 6, 2025):

false

<!-- gh-comment-id:2781142374 --> @github-actions[bot] commented on GitHub (Apr 6, 2025): false
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#134
No description provided.