[GH-ISSUE #103] YFCC100M Caption Preprocessing #91

Open
opened 2026-10-31 21:11:01 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @normster on GitHub (May 6, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/103

Hi,

I'm trying to reproduce the YFCC100M results and would like to know how image captions were preprocessed during training. For instance, how was the caption for the following sample extracted?

Title: denise%27s+peanut+chicken
Description: recipe+here%3A+%3Ca+href%3D%22http%3A%2F%2Fallrecipes.com%2FRecipe%2FDenises-Peanut-Chicken%2FDetail.aspx%22%3Eallrecipes.com%2FRecipe%2FDenises-Peanut-Chicken%2FDetail.aspx%3C%2Fa%3E%0Ai+added+1%2F2+teaspoon+of+sriracha+hot+chili+sauce+and+used+1+TBS+of+chunky+peanut+butter+in+place+of+the+2+cups+of+peanuts.

Best,
Norman

Originally created by @normster on GitHub (May 6, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/103 Hi, I'm trying to reproduce the YFCC100M results and would like to know how image captions were preprocessed during training. For instance, how was the caption for the following sample extracted? Title: `denise%27s+peanut+chicken` Description: `recipe+here%3A+%3Ca+href%3D%22http%3A%2F%2Fallrecipes.com%2FRecipe%2FDenises-Peanut-Chicken%2FDetail.aspx%22%3Eallrecipes.com%2FRecipe%2FDenises-Peanut-Chicken%2FDetail.aspx%3C%2Fa%3E%0Ai+added+1%2F2+teaspoon+of+sriracha+hot+chili+sauce+and+used+1+TBS+of+chunky+peanut+butter+in+place+of+the+2+cups+of+peanuts.` Best, Norman
Author
Owner

@naveenkumarmarri commented on GitHub (Oct 6, 2021):

You can decode as follows.

import urllib.parse
title = "denise%27s+peanut+chicken"
print(urllib.parse.unquote_plus(title))
# prints the following
"denise's peanut chicken"
<!-- gh-comment-id:936819464 --> @naveenkumarmarri commented on GitHub (Oct 6, 2021): You can decode as follows. ``` import urllib.parse title = "denise%27s+peanut+chicken" print(urllib.parse.unquote_plus(title)) # prints the following "denise's peanut chicken" ```
Author
Owner

@TonyLianLong commented on GitHub (Oct 25, 2021):

@jongwook In addition to the exact parsing method, could you tell us how a title is merged with the corresponding description text?

<!-- gh-comment-id:950570078 --> @TonyLianLong commented on GitHub (Oct 25, 2021): @jongwook In addition to the exact parsing method, could you tell us how a title is merged with the corresponding description text?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#91
No description provided.