[GH-ISSUE #319] (image,image) pairs? #274

Open
opened 2026-10-31 21:13:19 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @pokameng on GitHub (Jan 31, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/319

Hello , I want to know how to replace (image,text)r pairs with (image,image) pairs
@longouyang @welinder @JoshuaGross @jietang @esigler

Originally created by @pokameng on GitHub (Jan 31, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/319 Hello , I want to know how to replace (image,text)r pairs with (image,image) pairs @longouyang @welinder @JoshuaGross @jietang @esigler
Author
Owner

@sr5434 commented on GitHub (Jan 31, 2023):

I think in a Jupter Notebook in this repo, the author uses cosine similarity to compare the text and image features. It may be possible to use cosine similarity to compare 2 images. I think you might need to test it(I didn't).

<!-- gh-comment-id:1411200934 --> @sr5434 commented on GitHub (Jan 31, 2023): I think in a [Jupter Notebook in this repo](https://github.com/openai/CLIP/blob/main/notebooks/Interacting_with_CLIP.ipynb), the author uses cosine similarity to compare the text and image features. It may be possible to use cosine similarity to compare 2 images. I think you might need to test it(I didn't).
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#274
No description provided.