[GH-ISSUE #363] Question: How to produce a correct embedding for a dataset? #313

Open
opened 2026-10-31 21:13:45 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @GaetanoDibenedetto on GitHub (May 28, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/363

Hi, i was looking for a solution on various papers but I've not found the answer anywhere. I have a csv dataset, I would like to produce an embedding for each value of my csv, considering that I'm passing a string and an array representing an image as the inputs to the model. In the current state-of-the-art which is the better way to make the embedding for each value? Do i need to extract it from the model by passing the whole dataset as input or is it better if i give a single row of the dataset at the time?

Originally created by @GaetanoDibenedetto on GitHub (May 28, 2023). Original GitHub issue: https://github.com/openai/CLIP/issues/363 Hi, i was looking for a solution on various papers but I've not found the answer anywhere. I have a csv dataset, I would like to produce an embedding for each value of my csv, considering that I'm passing a string and an array representing an image as the inputs to the model. In the current state-of-the-art which is the better way to make the embedding for each value? Do i need to extract it from the model by passing the whole dataset as input or is it better if i give a single row of the dataset at the time?
Author
Owner

@mgupta70 commented on GitHub (Jan 31, 2024):

Assuming your csv has image array and also the corresponding text description, it makes no difference whether you do it in one go or one by one. The results will be the same.
I think what you mean is running in batches vs line-by-line. Running in batches allows you to use GPU, where multiple rows get processed simultaneously, and you get the results quickly. However, if you do it line-by-line, it will take longer.

<!-- gh-comment-id:1918609332 --> @mgupta70 commented on GitHub (Jan 31, 2024): Assuming your csv has image array and also the corresponding text description, it makes no difference whether you do it in one go or one by one. The results will be the same. I think what you mean is running in batches vs line-by-line. Running in batches allows you to use GPU, where multiple rows get processed simultaneously, and you get the results quickly. However, if you do it line-by-line, it will take longer.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#313
No description provided.