[PR #522] [CLOSED] Update SimpleTokenizer for SAM3 text tokenizer convenience #518

Closed
opened 2026-10-31 21:15:41 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/openai/CLIP/pull/522
Author: @Laughing-q
Created: 12/15/2025
Status: ❌ Closed

Base: main ← Head: simple-tokenizer


📝 Commits (10+)

📊 Changes

26 files changed (+4647 additions, -3466 deletions)

View changed files

➕ .github/ISSUE_TEMPLATE/bug-report.yml (+85 -0)
➕ .github/ISSUE_TEMPLATE/config.yml (+16 -0)
➕ .github/ISSUE_TEMPLATE/feature-request.yml (+51 -0)
➕ .github/ISSUE_TEMPLATE/question.yml (+34 -0)
➕ .github/dependabot.yml (+24 -0)
➕ .github/workflows/ci.yml (+39 -0)
➕ .github/workflows/format.yml (+35 -0)
➖ .github/workflows/test.yml (+0 -33)
📝 LICENSE (+656 -17)
📝 README.md (+230 -93)
📝 clip/__init__.py (+2 -0)
📝 clip/clip.py (+53 -35)
📝 clip/model.py (+137 -53)
📝 clip/simple_tokenizer.py (+76 -34)
📝 data/country211.md (+1 -1)
📝 data/prompts.md (+3081 -3134)
📝 data/rendered-sst2.md (+0 -1)
📝 data/yfcc100m.md (+3 -3)
📝 hubconf.py (+16 -5)
📝 model-card.md (+61 -26)

...and 6 more files

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/openai/CLIP/pull/522 **Author:** [@Laughing-q](https://github.com/Laughing-q) **Created:** 12/15/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `simple-tokenizer` --- ### 📝 Commits (10+) - [`c213791`](https://github.com/openai/CLIP/commit/c213791550bc49f121f65bda80857088d4f8f2b0) update device - [`e17416a`](https://github.com/openai/CLIP/commit/e17416a36b45d040758327936a1ea150c13fe3d1) fix DeprecationWarning - [`33adf5b`](https://github.com/openai/CLIP/commit/33adf5bc288d16fa6e8823085a63d688a2b62068) Add AGPL-3.0 License (#1) - [`fa20ebf`](https://github.com/openai/CLIP/commit/fa20ebf554d1e77513171174124b1cd271497253) Refactor code for speed and clarity (#3) - [`e942022`](https://github.com/openai/CLIP/commit/e942022ccc04d31c9920ba3858e19db1e5fe7949) Code Refactor `ruff check --fix --extend-select I` (#4) - [`a2b2205`](https://github.com/openai/CLIP/commit/a2b2205b0a65caf2c4b56349a3ff14b78e8678e1) Auto-format by https://ultralytics.com/actions - [`54694e4`](https://github.com/openai/CLIP/commit/54694e4e091f9a4250ea5e31033690b0f00b84d6) Ultralytics Refactor https://ultralytics.com/actions (#5) - [`0c1d532`](https://github.com/openai/CLIP/commit/0c1d532fcf7b12a7d3b4a344ea7a0c9a4a4c93e8) Fix HUB link https://ultralytics.com/hub (#6) - [`74d7272`](https://github.com/openai/CLIP/commit/74d72722e3b7c2a28961a805b20b5a7c05a75cf8) Add Discourse at https://community.ultralytics.com (#7) - [`68c3966`](https://github.com/openai/CLIP/commit/68c3966cf14f5bd031c144cccbf1cbe904932103) Ultralytics Actions JSON, CSS and autolabel support (#8) ### 📊 Changes **26 files changed** (+4647 additions, -3466 deletions) <details> <summary>View changed files</summary> ➕ `.github/ISSUE_TEMPLATE/bug-report.yml` (+85 -0) ➕ `.github/ISSUE_TEMPLATE/config.yml` (+16 -0) ➕ `.github/ISSUE_TEMPLATE/feature-request.yml` (+51 -0) ➕ `.github/ISSUE_TEMPLATE/question.yml` (+34 -0) ➕ `.github/dependabot.yml` (+24 -0) ➕ `.github/workflows/ci.yml` (+39 -0) ➕ `.github/workflows/format.yml` (+35 -0) ➖ `.github/workflows/test.yml` (+0 -33) 📝 `LICENSE` (+656 -17) 📝 `README.md` (+230 -93) 📝 `clip/__init__.py` (+2 -0) 📝 `clip/clip.py` (+53 -35) 📝 `clip/model.py` (+137 -53) 📝 `clip/simple_tokenizer.py` (+76 -34) 📝 `data/country211.md` (+1 -1) 📝 `data/prompts.md` (+3081 -3134) 📝 `data/rendered-sst2.md` (+0 -1) 📝 `data/yfcc100m.md` (+3 -3) 📝 `hubconf.py` (+16 -5) 📝 `model-card.md` (+61 -26) _...and 6 more files_ </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
bsakaguchi 2026-10-31 21:15:41 +00:00
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
openai/CLIP#518
No description provided.