mirror of
https://github.com/openai/CLIP.git
synced 2026-11-05 01:37:26 +00:00
[GH-ISSUE #489] CLIP’s Impressive Generalization – Any Future Updates? #413
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
openai/CLIP#413
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @arifur-rahman-ar on GitHub (Mar 12, 2025).
Original GitHub issue: https://github.com/openai/CLIP/issues/489
After reading the CLIP paper, I’m highly impressed by its ability to perform zero-shot learning and generalize across image-text tasks without task-specific fine-tuning. The contrastive learning approach, combined with large-scale internet pretraining, allows CLIP to match ResNet50 on ImageNet without labeled examples, which is a significant achievement.
However, I have a few questions regarding future improvements:
1.Model Variants: Are there any plans to release additional CLIP model variants with different architectures or training strategies?
2.Fine-Tuning Support: While CLIP excels at zero-shot learning, is there an official recommendation or upcoming support for fine-tuning it on specific datasets?
3.Performance on Complex Queries: Have there been any internal evaluations or planned improvements for handling more complex, multi-part queries?
Looking forward to any insights on these points. Thanks for the amazing work!