openai/CLIP
1
0
Fork 0
mirror of https://github.com/openai/CLIP.git synced 2026-11-05 01:37:26 +00:00
Code Issues 274 Projects Packages Wiki Activity

[GH-ISSUE #312] BC-breaking pytorch 1.9 vs 1.7.1 in multi_head_attention_forward #269

New issue
Closed
opened 2026-10-31 21:13:13 +00:00 by bsakaguchi · 1 comment
bsakaguchi commented 2026-10-31 21:13:13 +00:00
Owner
Copy link

Originally created by @Zhaoyi-Yan on GitHub (Jan 18, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/312

https://github.com/pytorch/pytorch/blob/v1.7.1/torch/nn/functional.py#L4222

https://github.com/pytorch/pytorch/blob/v1.9.0/torch/nn/functional.py#L4836

I cannot find scaling in pytorch 1.9, it seems has been removed. So, maybe First, [install PyTorch 1.7.1](https://pytorch.org/get-started/locally/) (or later) and torchvision is not correct.

Originally created by @Zhaoyi-Yan on GitHub (Jan 18, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/312 https://github.com/pytorch/pytorch/blob/v1.7.1/torch/nn/functional.py#L4222 https://github.com/pytorch/pytorch/blob/v1.9.0/torch/nn/functional.py#L4836 I cannot find `scaling` in pytorch 1.9, it seems has been removed. So, maybe `First, [install PyTorch 1.7.1](https://pytorch.org/get-started/locally/) (or later) and torchvision` is not correct.
bsakaguchi commented 2026-10-31 21:13:15 +00:00
Author
Owner
Copy link

@jongwook commented on GitHub (Jan 18, 2023):

It appears that they refactored the implementation, and the scaling part is now in:

https://github.com/pytorch/pytorch/blob/v1.9.0/torch/nn/functional.py#L4823

<!-- gh-comment-id:1387493368 --> @jongwook commented on GitHub (Jan 18, 2023): It appears that they refactored the implementation, and the scaling part is now in: https://github.com/pytorch/pytorch/blob/v1.9.0/torch/nn/functional.py#L4823
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
codex/pin-github-workflow-refs-20260325-132838
jongwook/issue-396
jongwook-patch-1
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#269
No description provided.