[GH-ISSUE #378] Make a smaller ModifiedResnet model #324

Open
opened 2026-10-31 21:13:51 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @justlike-prog on GitHub (Jul 18, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/378

Hi,

The R50 image encoder is around 250MB in size. Was anyone here able to reduce the size drastically (to around 20MB)? I was thinking about doing knowledge distillation with a student model that has also ModifiedResnet architecture, but with fewer layers, filters and so on.

Any ideas and experiences are welcome :)

Originally created by @justlike-prog on GitHub (Jul 18, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/378 Hi, The R50 image encoder is around 250MB in size. Was anyone here able to reduce the size drastically (to around 20MB)? I was thinking about doing knowledge distillation with a student model that has also ModifiedResnet architecture, but with fewer layers, filters and so on. Any ideas and experiences are welcome :)
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#324
No description provided.