mirror of
https://github.com/openai/CLIP.git
synced 2026-11-05 01:37:26 +00:00
[GH-ISSUE #526] Difference between CLIP and OmiCLIP foundation model #440
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
openai/CLIP#440
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @linjing-lab on GitHub (Jan 14, 2026).
Original GitHub issue: https://github.com/openai/CLIP/issues/526
Hi, I recently read a paper on the application of the latest CLIP model in spatial transcriptomics, a visual–omics foundation model to bridge histopathology with spatial transcriptomics, which uses the alignment of tissue images and transcriptome to complete the image to omics alignment. I want to know whether the difference between CLIP and OmiCLIP core is only reflected in the pretrained weights or in other places under such a pretraining mode. In addition, the number of pretraining datasets of OmiCLIP is relatively limited compared with the general CLIP model. OmiCLIP does not cover enough rare diseases. I want to know whether a general CLIP model can be fine tuned to a model similar to OmiCLIP.