[GH-ISSUE #174] Emoji in Text #153

Closed
opened 2026-10-31 21:11:45 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @steveguang on GitHub (Nov 5, 2021).
Original GitHub issue: https://github.com/openai/CLIP/issues/174

Is clip model able to process emoji? or text and images only? I tried to encode two emojis '😀' and '😃'. It generates two embeddings that are different. they are like,
array([[5.50842285e-02, 2.57812500e-01, 4.94384766e-02, .....
array([[ 7.32421875e-02, 3.23242188e-01, 1.26586914e-01,......
Any reason why? It doesnt seem to be random

Originally created by @steveguang on GitHub (Nov 5, 2021). Original GitHub issue: https://github.com/openai/CLIP/issues/174 Is clip model able to process emoji? or text and images only? I tried to encode two emojis '😀' and '😃'. It generates two embeddings that are different. they are like, array([[5.50842285e-02, 2.57812500e-01, 4.94384766e-02, ..... array([[ 7.32421875e-02, 3.23242188e-01, 1.26586914e-01,...... Any reason why? It doesnt seem to be random
Author
Owner

@jongwook commented on GitHub (Nov 16, 2021):

The BPE encoding supports arbitrary UTF-8 sequence, and it can encode and decode emoji characters accordingly. It'd be interesting project to plot the t-SNE of emoji embeddings.

<!-- gh-comment-id:969671487 --> @jongwook commented on GitHub (Nov 16, 2021): The BPE encoding supports arbitrary UTF-8 sequence, and it can encode and decode emoji characters accordingly. It'd be interesting project to plot the t-SNE of emoji embeddings.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#153
No description provided.