[GH-ISSUE #238] RN50x64 Model encodes image failed with size dismatch #206

New issue

Closed

opened 2026-10-31 21:12:26 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-31 21:12:26 +00:00

Owner

Originally created by @Wayne-Mai on GitHub (Apr 27, 2022).
Original GitHub issue: https://github.com/openai/CLIP/issues/238

Hi, I am using "RN50x64" clip model to encode images. Specifically, I use image_z = self.clip_model.encode_image(pred_rgb)
to encode pred_rgb of shape [8,3,224,224] but failed with:

 File "~/anaconda3/envs/text/lib/python3.9/site-packages/clip/model.py", line 69, in forward
    x = x + self.positional_embedding[:, None, :].to(x.dtype)  # (HW+1)NC
RuntimeError: The size of tensor a (50) must match the size of tensor b (197) at non-singleton dimension 0

Originally created by @Wayne-Mai on GitHub (Apr 27, 2022). Original GitHub issue: https://github.com/openai/CLIP/issues/238 Hi, I am using "RN50x64" clip model to encode images. Specifically, I use `image_z = self.clip_model.encode_image(pred_rgb)` to encode `pred_rgb` of shape `[8,3,224,224]` but failed with: ``` File "~/anaconda3/envs/text/lib/python3.9/site-packages/clip/model.py", line 69, in forward x = x + self.positional_embedding[:, None, :].to(x.dtype) # (HW+1)NC RuntimeError: The size of tensor a (50) must match the size of tensor b (197) at non-singleton dimension 0 ```

bsakaguchi closed this issue

2026-10-31 21:12:26 +00:00

bsakaguchi commented

2026-10-31 21:12:27 +00:00

Author

Owner

@robertodessi commented on GitHub (Jun 3, 2022):

Hi, I found a similar error. Were you able to fix it in the end?

@robertodessi commented on GitHub (Jun 3, 2022): Hi, I found a similar error. Were you able to fix it in the end?

bsakaguchi commented

2026-10-31 21:12:27 +00:00

Author