deepseek-ai/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2026-11-05 00:47:42 +00:00
Code Issues 45 Projects Packages Wiki Activity

[GH-ISSUE #799] Failed to red image correct #657

New issue
Closed
opened 2026-10-26 21:24:40 +00:00 by bsakaguchi · 4 comments
bsakaguchi commented 2026-10-26 21:24:40 +00:00
Owner
Copy link

Originally created by @i-find-flaws-in-AI-programming on GitHub (Feb 16, 2026).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/799

Bug Report: Visual Misidentification in DeepSeek Image Analysis

Bug ID: DEEPSEEK-VISION-001
Date: 2025-04-09
Reported by: [User]

Description

When analyzing two full-base screenshots from Clash of Clans (IMG_2089.png and IMG_2090.png), the DeepSeek model incorrectly identified an Archer Tower as a Cannon. This led to an erroneous count of 8 Cannons at Town Hall 11, where the actual maximum is 7 Cannons per game data.

Evidence

Images Provided:

  • IMG_2089.png — top half of base
  • IMG_2090.png — bottom half of base

User-Confirmed Facts:

  • Town Hall level: 11 (visible icon confirms)
  • Cannons: All maxed (level 15)

What the Model Did Wrong

  1. Misidentified Structure:

    • In the bottom center of the base (above the "Attack!" button), an Archer Tower was visually mistaken for a Cannon.

  2. Overcounted:

    • Model counted 3 Cannons in the bottom row:
      • Bottom left ✅ (correct)
      • Bottom center ❌ (incorrect — actually an Archer Tower)
      • Bottom right ✅ (correct)
    • Combined with 5 Cannons from the rest of the base, total became 8.

  3. Failed Cross-Check:

    • Did not compare detected count against known game limit (TH11 max Cannons = 7) to flag the discrepancy.

Root Cause

  • Visual Similarity Confusion: The model relied too heavily on general shape (round base structure behind walls) without distinguishing finer architectural differences between Cannons and Archer Towers.
  • Lack of Game-Knowledge Integration: No validation step was applied to ensure the count did not exceed the maximum possible for the given Town Hall level.
  • Context Ignorance: The model did not verify whether the 8th candidate might already be accounted for as another building type (e.g., an Archer Tower already counted elsewhere).

Correct Answer

  • Total Cannons: 7
  • Total Cannons Needing Upgrade: 0 (all maxed)
  • Correct Count Across Base:
    1. Top left
    2. Top right
    3. Left of Town Hall
    4. Right of Town Hall
    5. Behind Clan Castle
    6. Bottom left corner
    7. Bottom right corner

Suggested Fixes

  1. Improve Visual Differentiation Training:

    • Train the model on finer distinguishing features between visually similar defensive buildings (e.g., Cannon vs. Archer Tower).

  2. Implement Game-Knowledge Validation:

    • Cross-reference detected counts against known game data (e.g., "TH11 max Cannons = 7") and flag any result that exceeds the limit for re-review.

  3. Add Multi-Feature Verification:

    • Require at least two distinguishing attributes (e.g., shape + position relative to walls + comparison to nearby structures) before finalizing identification.

Impact

  • User Trust: Repeated errors eroded confidence in the model's ability to accurately read and analyze images.
  • Accuracy: Minor but persistent misidentifications lead to incorrect conclusions and user frustration.

Attachments

  • IMG_2089.png
  • IMG_2090.png
  • Bug report code (provided separately)

Report submitted by: [I find flaws in AI programming

Image Image Image Image Image

For: DeepSeek Vision Development Team

Originally created by @i-find-flaws-in-AI-programming on GitHub (Feb 16, 2026). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/799 # Bug Report: Visual Misidentification in DeepSeek Image Analysis **Bug ID:** DEEPSEEK-VISION-001 **Date:** 2025-04-09 **Reported by:** [User] --- ## Description When analyzing two full-base screenshots from Clash of Clans (IMG_2089.png and IMG_2090.png), the DeepSeek model incorrectly identified an **Archer Tower** as a **Cannon**. This led to an erroneous count of **8 Cannons** at Town Hall 11, where the actual maximum is **7 Cannons** per game data. --- ## Evidence **Images Provided:** - `IMG_2089.png` — top half of base - `IMG_2090.png` — bottom half of base **User-Confirmed Facts:** - Town Hall level: **11** (visible icon confirms) - Cannons: All **maxed** (level 15) --- ## What the Model Did Wrong 1. **Misidentified Structure:** - In the bottom center of the base (above the "Attack!" button), an Archer Tower was visually mistaken for a Cannon. 2. **Overcounted:** - Model counted 3 Cannons in the bottom row: - Bottom left ✅ (correct) - Bottom center ❌ (incorrect — actually an Archer Tower) - Bottom right ✅ (correct) - Combined with 5 Cannons from the rest of the base, total became **8**. 3. **Failed Cross-Check:** - Did not compare detected count against known game limit (TH11 max Cannons = 7) to flag the discrepancy. --- ## Root Cause - **Visual Similarity Confusion:** The model relied too heavily on general shape (round base structure behind walls) without distinguishing finer architectural differences between Cannons and Archer Towers. - **Lack of Game-Knowledge Integration:** No validation step was applied to ensure the count did not exceed the maximum possible for the given Town Hall level. - **Context Ignorance:** The model did not verify whether the 8th candidate might already be accounted for as another building type (e.g., an Archer Tower already counted elsewhere). --- ## Correct Answer - **Total Cannons:** 7 - **Total Cannons Needing Upgrade:** 0 (all maxed) - **Correct Count Across Base:** 1. Top left 2. Top right 3. Left of Town Hall 4. Right of Town Hall 5. Behind Clan Castle 6. Bottom left corner 7. Bottom right corner --- ## Suggested Fixes 1. **Improve Visual Differentiation Training:** - Train the model on finer distinguishing features between visually similar defensive buildings (e.g., Cannon vs. Archer Tower). 2. **Implement Game-Knowledge Validation:** - Cross-reference detected counts against known game data (e.g., "TH11 max Cannons = 7") and flag any result that exceeds the limit for re-review. 3. **Add Multi-Feature Verification:** - Require at least two distinguishing attributes (e.g., shape + position relative to walls + comparison to nearby structures) before finalizing identification. --- ## Impact - **User Trust:** Repeated errors eroded confidence in the model's ability to accurately read and analyze images. - **Accuracy:** Minor but persistent misidentifications lead to incorrect conclusions and user frustration. --- ## Attachments - `IMG_2089.png` - `IMG_2090.png` - Bug report code (provided separately) --- **Report submitted by:** [I find flaws in AI programming <img width="2556" height="1179" alt="Image" src="https://github.com/user-attachments/assets/1a0237bd-c28b-499d-9f61-42a804eca7c8" /> <img width="2556" height="1179" alt="Image" src="https://github.com/user-attachments/assets/f0e9e88f-5443-41d2-8e8f-4d9014491f22" /> <img width="2556" height="1179" alt="Image" src="https://github.com/user-attachments/assets/fb37f83a-c68c-4c01-80ed-d6cf8c6e3aed" /> <img width="2556" height="1179" alt="Image" src="https://github.com/user-attachments/assets/46acb279-2305-42c9-a6cf-a11af9b40919" /> <img width="2556" height="1179" alt="Image" src="https://github.com/user-attachments/assets/b4aaea47-cc14-43ac-9ae9-fc889fc3326b" /> **For:** DeepSeek Vision Development Team
bsakaguchi 2026-10-26 21:24:40 +00:00
bsakaguchi commented 2026-10-26 21:24:41 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Mar 19, 2026):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:4086524085 --> @github-actions[bot] commented on GitHub (Mar 19, 2026): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
bsakaguchi commented 2026-10-26 21:24:41 +00:00
Author
Owner
Copy link

@i-find-flaws-in-AI-programming commented on GitHub (Mar 19, 2026):

Fix it

<!-- gh-comment-id:4089588284 --> @i-find-flaws-in-AI-programming commented on GitHub (Mar 19, 2026): Fix it
bsakaguchi commented 2026-10-26 21:24:41 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Apr 19, 2026):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:4274839313 --> @github-actions[bot] commented on GitHub (Apr 19, 2026): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
bsakaguchi commented 2026-10-26 21:24:42 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (May 3, 2026):

false

<!-- gh-comment-id:4365029073 --> @github-actions[bot] commented on GitHub (May 3, 2026): false
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
v1.0.0
Labels
Clear labels   
bug

   
closed-as-stale

   
closed-as-stale

   
enhancement

   
pull-request
Mirrored from GitHub Pull Request

  
stale

   
stale
No labels
bug
closed-as-stale
closed-as-stale
enhancement
pull-request
stale
stale
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#657
No description provided.