openai/CLIP
1
0
Fork 0
mirror of https://github.com/openai/CLIP.git synced 2026-11-05 01:37:26 +00:00
Code Issues 274 Projects Packages Wiki Activity

[GH-ISSUE #202] Linear prob evaluation on ImageNet #177

New issue
Open
opened 2026-10-31 21:12:02 +00:00 by bsakaguchi · 4 comments
bsakaguchi commented 2026-10-31 21:12:02 +00:00
Owner
Copy link

Originally created by @vtddggg on GitHub (Dec 27, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/202

Thanks for your wonderful work!

I have some questions about linear prob evaluation on ImageNet:

  1. how do you conduct linear prob evaluation on ImageNet? using sklearn.linear_model.LogisticRegression or finetuning fc layer like this script
  2. if answer of 1) is Yes. I found do LogisticRegression on ImageNet is very costly. Can I ask for your time spend on ImageNet linear prob evaluation experiment ?
Originally created by @vtddggg on GitHub (Dec 27, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/202 Thanks for your wonderful work! I have some questions about linear prob evaluation on ImageNet: 1) how do you conduct linear prob evaluation on ImageNet? using `sklearn.linear_model.LogisticRegression` or finetuning fc layer like [this script](https://github.com/facebookresearch/moco-v3/blob/main/main_lincls.py) 2) if answer of 1) is Yes. I found do LogisticRegression on ImageNet is very costly. Can I ask for your time spend on ImageNet linear prob evaluation experiment ?
bsakaguchi commented 2026-10-31 21:12:02 +00:00
Author
Owner
Copy link

@jongwook commented on GitHub (Apr 11, 2022):

Hi,

  1. Yes, but we later found that a PyTorch version can work as equivalently on linear probes.
  2. Please see https://github.com/openai/CLIP/issues/64#issuecomment-804444364 for more details
<!-- gh-comment-id:1094474631 --> @jongwook commented on GitHub (Apr 11, 2022): Hi, 1. Yes, but we later found that a PyTorch version can work as equivalently on linear probes. 2. Please see https://github.com/openai/CLIP/issues/64#issuecomment-804444364 for more details
bsakaguchi commented 2026-10-31 21:12:02 +00:00
Author
Owner
Copy link

@mingtan2 commented on GitHub (Aug 30, 2022):

a PyTorch version can work as equivalently on linear probes.
Hi @jongwook , could you share the details or script for the PyTorch version? Thanks.

<!-- gh-comment-id:1232092794 --> @mingtan2 commented on GitHub (Aug 30, 2022): > a PyTorch version can work as equivalently on linear probes. Hi @jongwook , could you share the details or script for the PyTorch version? Thanks.
bsakaguchi commented 2026-10-31 21:12:02 +00:00
Author
Owner
Copy link

@jyuan-git commented on GitHub (Mar 27, 2023):

Did you found the equivalently pytorch verson?

<!-- gh-comment-id:1486013032 --> @jyuan-git commented on GitHub (Mar 27, 2023): > Did you found the equivalently pytorch verson?
bsakaguchi commented 2026-10-31 21:12:02 +00:00
Author
Owner
Copy link

@jongwook commented on GitHub (Apr 11, 2023):

These both worked well for us:

<!-- gh-comment-id:1504270019 --> @jongwook commented on GitHub (Apr 11, 2023): These both worked well for us: - PyTorch's stock LBFGS: https://pytorch.org/docs/stable/generated/torch.optim.LBFGS.html - A third-party implementation that has more features: https://github.com/hjmshi/PyTorch-LBFGS
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
codex/pin-github-workflow-refs-20260325-132838
jongwook/issue-396
jongwook-patch-1
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#177
No description provided.