[GH-ISSUE #399] Is the clip preprocessor differentiable ? #340

Open
opened 2026-10-31 21:14:06 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @aradhyamathur on GitHub (Nov 7, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/399

Hi, I had a query pertaining to the clip preprocessor , say i have an image that is generated by some other network, if i process it using clip preprocessor will i be able to backprop the gradients back to the original model ?

Originally created by @aradhyamathur on GitHub (Nov 7, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/399 Hi, I had a query pertaining to the clip preprocessor , say i have an image that is generated by some other network, if i process it using clip preprocessor will i be able to backprop the gradients back to the original model ?
Author
Owner

@zhaoyl18 commented on GitHub (Jan 5, 2024):

I have exactly the same question. It seems it can't. Do you have any idea how to make it differentiable?

<!-- gh-comment-id:1878030237 --> @zhaoyl18 commented on GitHub (Jan 5, 2024): I have exactly the same question. It seems it can't. Do you have any idea how to make it differentiable?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#340
No description provided.