mirror of
https://github.com/openai/CLIP.git
synced 2026-11-05 01:37:26 +00:00
[GH-ISSUE #363] Question: How to produce a correct embedding for a dataset? #313
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
openai/CLIP#313
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @GaetanoDibenedetto on GitHub (May 28, 2023).
Original GitHub issue: https://github.com/openai/CLIP/issues/363
Hi, i was looking for a solution on various papers but I've not found the answer anywhere. I have a csv dataset, I would like to produce an embedding for each value of my csv, considering that I'm passing a string and an array representing an image as the inputs to the model. In the current state-of-the-art which is the better way to make the embedding for each value? Do i need to extract it from the model by passing the whole dataset as input or is it better if i give a single row of the dataset at the time?
@mgupta70 commented on GitHub (Jan 31, 2024):
Assuming your csv has image array and also the corresponding text description, it makes no difference whether you do it in one go or one by one. The results will be the same.
I think what you mean is running in batches vs line-by-line. Running in batches allows you to use GPU, where multiple rows get processed simultaneously, and you get the results quickly. However, if you do it line-by-line, it will take longer.