[GH-ISSUE #445] Question about Checkpoint on ResNet-50. #380

Open
opened 2026-10-31 21:14:31 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @MorningStarOvO on GitHub (May 20, 2024).
Original GitHub issue: https://github.com/openai/CLIP/issues/445

Have the parameters of ResNet-50 been changed in three years?

It's hard to reproduce the results of the original paper with the downloaded parameters on ResNet-50 now, but it's amazing that they are reproduced with the ViT backbone.

Using the latest version of the CLIP code now, it's not clear what's causing this. The results in the ViT architecture are almost comparable to the original paper, but ResNet50 tested more than 10 datasets and they were much worse!

Originally created by @MorningStarOvO on GitHub (May 20, 2024). Original GitHub issue: https://github.com/openai/CLIP/issues/445 Have the parameters of ResNet-50 been changed in three years? It's hard to reproduce the results of the original paper with the downloaded parameters on ResNet-50 now, but it's amazing that they are reproduced with the ViT backbone. Using the latest version of the CLIP code now, it's not clear what's causing this. The results in the ViT architecture are almost comparable to the original paper, but ResNet50 tested more than 10 datasets and they were much worse!
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#380
No description provided.