theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-22 23:38:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Simplify add_bos_token handling

Browse Source 
Set add_bos_token to True by default in the tokenizer_config stub.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-05-02 21:30:18 -04:00
parent 4cb3e5d5b1
commit 242f6b7d2a
3 changed files with 6 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
backends/base_model_container.py
View File

@@ -127,9 +127,6 @@ class BaseModelContainer(abc.ABC):
"""
Gets special tokens used by the model/tokenizer.
Args:
**kwargs: Options like add_bos_token, ban_eos_token.
Returns:
A dictionary mapping special token names (e.g., 'bos_token', 'eos_token')
to their string or ID representation.