theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

Sampling: Make add_bos_token override concise

Browse Source 
Also set the default to None so text completions follows the same
pattern.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-05-10 19:07:35 -04:00
parent 656af41b5d
commit 6379081dd8
3 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/sampling.py
View File

@@ -205,7 +205,7 @@ class BaseSamplerRequest(BaseModel):
)
add_bos_token: Optional[bool] = Field(
default_factory=lambda: get_default_sampler_value("add_bos_token", True)
default_factory=lambda: get_default_sampler_value("add_bos_token")
)
ban_eos_token: Optional[bool] = Field(