openai/CLIP
1
0
Fork 0
mirror of https://github.com/openai/CLIP.git synced 2026-11-05 01:37:26 +00:00
Code Issues 274 Projects Packages Wiki Activity

[GH-ISSUE #53] Poppies are detected as poodles #48

New issue
Closed
opened 2026-10-31 21:10:12 +00:00 by bsakaguchi · 3 comments
bsakaguchi commented 2026-10-31 21:10:12 +00:00
Owner
Copy link

Originally created by @Jo-Pan on GitHub (Mar 5, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/53

I am using a private dataset. However, I discover that all the poppies images are detected as poodles. I used the given checkpoint to test. I wonder if there is any mistake in labeling during training.

Details:
Model used: "https://openaipublic.azureedge.net/clip/models/40d365715913c9da98579312b702a82c18be219cc2a73407c4526f58eba950af/ViT-B-32.pt"

Text used for poppies: 'an image of poppies, a type of flower'
Text used for poodles: 'an image of poodles, a type of dogs'

Screen Shot 2021-03-05 at 12 51 46 PM Screen Shot 2021-03-05 at 12 53 26 PM
Originally created by @Jo-Pan on GitHub (Mar 5, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/53 I am using a private dataset. However, I discover that all the poppies images are detected as poodles. I used the given checkpoint to test. I wonder if there is any mistake in labeling during training. Details: Model used: "https://openaipublic.azureedge.net/clip/models/40d365715913c9da98579312b702a82c18be219cc2a73407c4526f58eba950af/ViT-B-32.pt" Text used for poppies: 'an image of poppies, a type of flower' Text used for poodles: 'an image of poodles, a type of dogs' <img width="813" alt="Screen Shot 2021-03-05 at 12 51 46 PM" src="https://user-images.githubusercontent.com/29980839/110153834-8d67b700-7db1-11eb-937e-4e8e9a5eb60a.png"> <img width="839" alt="Screen Shot 2021-03-05 at 12 53 26 PM" src="https://user-images.githubusercontent.com/29980839/110154048-c9028100-7db1-11eb-92c8-c9a13ffb1f8e.png">
bsakaguchi commented 2026-10-31 21:10:14 +00:00
Author
Owner
Copy link

@gwern commented on GitHub (Mar 8, 2021):

What about "puppies"?

<!-- gh-comment-id:793117754 --> @gwern commented on GitHub (Mar 8, 2021): What about "puppies"?
bsakaguchi commented 2026-10-31 21:10:14 +00:00
Author
Owner
Copy link

@LaCavao commented on GitHub (Mar 12, 2021):

That's very strange -- I'm hosting the same model here, but it can differentiate between poppies/poodles no problem, so I don't think it's inherent to the CLIP checkpoint.

<!-- gh-comment-id:797556113 --> @LaCavao commented on GitHub (Mar 12, 2021): That's very strange -- I'm hosting the same model [here](https://clip.kiri.ai), but it can differentiate between poppies/poodles no problem, so I don't think it's inherent to the CLIP checkpoint.
bsakaguchi commented 2026-10-31 21:10:14 +00:00
Author
Owner
Copy link

@Jo-Pan commented on GitHub (Mar 12, 2021):

Thanks to all who checked for me, @LaCavao @gwern. With a cleaned-up model, this issue is now solved.

<!-- gh-comment-id:797673617 --> @Jo-Pan commented on GitHub (Mar 12, 2021): Thanks to all who checked for me, @LaCavao @gwern. With a cleaned-up model, this issue is now solved.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
codex/pin-github-workflow-refs-20260325-132838
jongwook/issue-396
jongwook-patch-1
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#48
No description provided.