turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-04-20 14:29:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

Remove SentencePiece support

Browse Source
This commit is contained in:
turboderp
2025-05-14 15:30:57 +02:00
parent a87ea02830
commit 1adff7d827
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
exllamav2/tokenizer/__init__.py
View File

@@ -1,5 +1,4 @@
from exllamav2.version import __version__
from exllamav2.tokenizer.base import ExLlamaV2TokenizerBase
from exllamav2.tokenizer.spm import ExLlamaV2TokenizerSPM
from exllamav2.tokenizer.hf import ExLlamaV2TokenizerHF