theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

Samplers: Minor fixes for sampler override

Browse Source 
* Add missing settings to sample_preset.yml
* Fix override for skip_special_tokens
This commit is contained in:
DocShotgun
2024-05-12 00:31:31 -07:00
parent c8ec742be9
commit 9463ecfa40
2 changed files with 8 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/sampling.py
View File

@@ -121,7 +121,7 @@ class BaseSamplerRequest(BaseModel):
)
skip_special_tokens: Optional[bool] = Field(
default_factory=lambda: get_default_sampler_value("ban_eos_token", True),
default_factory=lambda: get_default_sampler_value("skip_special_tokens", True),
examples=[True],
)

7
sampler_overrides/sample_preset.yml
View File

@@ -112,10 +112,17 @@ add_bos_token:
ban_eos_token:
override: false
force: false
skip_special_tokens:
override: true
force: false
logit_bias:
override:
force: false
additive: false
banned_tokens:
override: []
force: false
additive: false
# MARK: CFG scale
cfg_scale: