[GH-ISSUE #4] colab is broken ? #6

New issue

Closed

opened 2026-10-31 21:09:49 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-31 21:09:49 +00:00

Owner

Originally created by @evanthebouncy on GitHub (Jan 6, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/4

this cell:

tokenizer = SimpleTokenizer()
text_tokens = [tokenizer.encode("This is " + desc + "<|endoftext|>") for desc in texts]

when you run it, generates the following error:

NameError Traceback (most recent call last)
in ()
----> 1 tokenizer = SimpleTokenizer()
2 text_tokens = [tokenizer.encode("This is " + desc + "<|endoftext|>") for desc in texts]

NameError: name 'SimpleTokenizer' is not defined

Originally created by @evanthebouncy on GitHub (Jan 6, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/4 this cell: tokenizer = SimpleTokenizer() text_tokens = [tokenizer.encode("This is " + desc + "<|endoftext|>") for desc in texts] when you run it, generates the following error: --------------------------------------------------------------------------- NameError Traceback (most recent call last) <ipython-input-16-ed0057d0ca54> in <module>() ----> 1 tokenizer = SimpleTokenizer() 2 text_tokens = [tokenizer.encode("This is " + desc + "<|endoftext|>") for desc in texts] NameError: name 'SimpleTokenizer' is not defined

bsakaguchi closed this issue

2026-10-31 21:09:49 +00:00

bsakaguchi commented

2026-10-31 21:09:49 +00:00

Author

Owner

@jongwook commented on GitHub (Jan 6, 2021):

Hi, there is a hidden cell above that in the "text preprocessing" section. Could you check if that cell was executed?

@jongwook commented on GitHub (Jan 6, 2021): Hi, there is a hidden cell above that in the "text preprocessing" section. Could you check if that cell was executed?

bsakaguchi commented

2026-10-31 21:09:49 +00:00

Author

Owner

@evanthebouncy commented on GitHub (Jan 7, 2021):

sorry I must have missed that cell. this has been resolved. thanks !

@evanthebouncy commented on GitHub (Jan 7, 2021): sorry I must have missed that cell. this has been resolved. thanks !

bsakaguchi referenced this issue

2026-10-31 21:15:41 +00:00

[PR #522] [CLOSED] Update SimpleTokenizer for SAM3 text tokenizer convenience #518