[GH-ISSUE #266] training curve of CLIP #232

Open
opened 2026-10-31 21:12:46 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @bladewaltz1 on GitHub (Jul 12, 2022).
Original GitHub issue: https://github.com/openai/CLIP/issues/266

Hi, thanks for the great work!

I am trying to train a CLIP model on 1M image-text pairs with a batch size of 1920, and the training loss converges to around 3 after 50 epochs. I am wondering if this is a normal behavior? I would be really appreciated if you can provide me the training loss curve of the original CLIP model, or at least let me know the final loss value of the CLIP model.

Thank you very much!

Originally created by @bladewaltz1 on GitHub (Jul 12, 2022). Original GitHub issue: https://github.com/openai/CLIP/issues/266 Hi, thanks for the great work! I am trying to train a CLIP model on 1M image-text pairs with a batch size of 1920, and the training loss converges to around 3 after 50 epochs. I am wondering if this is a normal behavior? I would be really appreciated if you can provide me the training loss curve of the original CLIP model, or at least let me know the final loss value of the CLIP model. Thank you very much!
Author
Owner

@krishanrana commented on GitHub (Jan 19, 2023):

I am having a similar issue and not sure if i should keep letting it train for longer as it there seems to still be a slow downward trend?

<!-- gh-comment-id:1396510227 --> @krishanrana commented on GitHub (Jan 19, 2023): I am having a similar issue and not sure if i should keep letting it train for longer as it there seems to still be a slow downward trend?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#232
No description provided.