[GH-ISSUE #5] Non-jit version of model? #5

Closed
opened 2026-10-31 21:09:48 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @jmhessel on GitHub (Jan 7, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/5

Hi!

Thanks for the code release, and for the great work!! I was wondering if it might be possible to release a non-jit version of the model. This might make it easier to convert to other platforms, e.g., tensorflow. What do you think?

Jack

Originally created by @jmhessel on GitHub (Jan 7, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/5 Hi! Thanks for the code release, and for the great work!! I was wondering if it might be possible to release a non-jit version of the model. This might make it easier to convert to other platforms, e.g., tensorflow. What do you think? Jack
Author
Owner

@jongwook commented on GitHub (Jan 7, 2021):

Hello, thanks for your interest! We wanted to keep the release volume minimal and decided to release the JIT model only.

That being said, I guess it'll be relatively straightforward to recover the Python code from the JIT model via model.code, model.visual.code, etc. (I wonder if there's an automated tool for this)

I also expect there will be implementations like lucidrains' or others that will support importing the CLIP model weights.

<!-- gh-comment-id:756264306 --> @jongwook commented on GitHub (Jan 7, 2021): Hello, thanks for your interest! We wanted to keep the release volume minimal and decided to release the JIT model only. That being said, I guess it'll be relatively straightforward to recover the Python code from the JIT model via `model.code`, `model.visual.code`, etc. (I wonder if there's an automated tool for this) I also expect there will be implementations like [lucidrains'](https://github.com/lucidrains/DALLE-pytorch/blob/b794832f12bb6367d9b3ae4462a3d227e7560412/dalle_pytorch/dalle_pytorch.py#L151-L229) or others that will support importing the CLIP model weights.
Author
Owner

@jmhessel commented on GitHub (Jan 7, 2021):

Gotcha, that makes sense! It's definitely possible to get a non-JIT version using model.code, just a bit tedious :) Thanks!

<!-- gh-comment-id:756341872 --> @jmhessel commented on GitHub (Jan 7, 2021): Gotcha, that makes sense! It's definitely possible to get a non-JIT version using `model.code`, just a bit tedious :) Thanks!
Author
Owner

@jongwook commented on GitHub (Jan 12, 2021):

Hello! As written in #9 as well, we are preparing to release the model code this week, which will allow users to inspect and modify the architecture more conveniently.

<!-- gh-comment-id:758386066 --> @jongwook commented on GitHub (Jan 12, 2021): Hello! As written in #9 as well, we are preparing to release the model code this week, which will allow users to inspect and modify the architecture more conveniently.
Author
Owner

@jongwook commented on GitHub (Jan 12, 2021):

The model code is now available in model.py

<!-- gh-comment-id:759105874 --> @jongwook commented on GitHub (Jan 12, 2021): The model code is now available in [model.py](https://github.com/openai/CLIP/blob/main/model.py)
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#5
No description provided.