[GH-ISSUE #332] How to add the scheduler to the Model CLIP? #288

Closed
opened 2026-10-31 21:13:28 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @hongruijia on GitHub (Mar 3, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/332

I tried to add a scheduler to the model CLIP, but the learning rate didn't update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so what is the problem of it?

Originally created by @hongruijia on GitHub (Mar 3, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/332 I tried to add a scheduler to the model CLIP, but the learning rate didn't update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so what is the problem of it?
Author
Owner

@MadcowD commented on GitHub (Mar 3, 2023):

Have you tried using the StepLR scheduler instead of the
WarmupCosineSchedule? It may work better for your needs.

On Thu, Mar 2, 2023 at 6:26 PM APiaoG @.***> wrote:

I tried to add a scheduler to the model CLIP, but the learning rate didn't
update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so
what is the problem of it?

—
Reply to this email directly, view it on GitHub
https://github.com/openai/CLIP/issues/332, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFPVLZ46RKKMUMLSJ6KW4TW2FJFBANCNFSM6AAAAAAVOB2OTQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

<!-- gh-comment-id:1452872078 --> @MadcowD commented on GitHub (Mar 3, 2023): Have you tried using the StepLR scheduler instead of the WarmupCosineSchedule? It may work better for your needs. On Thu, Mar 2, 2023 at 6:26 PM APiaoG ***@***.***> wrote: > I tried to add a scheduler to the model CLIP, but the learning rate didn't > update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so > what is the problem of it? > > — > Reply to this email directly, view it on GitHub > <https://github.com/openai/CLIP/issues/332>, or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAFPVLZ46RKKMUMLSJ6KW4TW2FJFBANCNFSM6AAAAAAVOB2OTQ> > . > You are receiving this because you are subscribed to this thread.Message > ID: ***@***.***> >
Author
Owner

@hongruijia commented on GitHub (May 19, 2023):

Thank you and I have solved this problem!

<!-- gh-comment-id:1554167977 --> @hongruijia commented on GitHub (May 19, 2023): Thank you and I have solved this problem!
Author
Owner

@MuhiimAli commented on GitHub (Jul 8, 2024):

How did you solve the problem? I am running into the same issue now

<!-- gh-comment-id:2214152559 --> @MuhiimAli commented on GitHub (Jul 8, 2024): How did you solve the problem? I am running into the same issue now
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#288
No description provided.