theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Config: Enable safe sampler overrides by default

Browse Source 
* Provides safe fallback samplers, intended for better out-of-the-box support for clients that do not pass sampler params
This commit is contained in:
DocShotgun
2025-08-18 12:32:28 -07:00
parent a4d02c2b70
commit 998abe5ad1
4 changed files with 20 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
common/config_models.py
View File

@@ -406,10 +406,13 @@ class SamplingConfig(BaseConfigModel):
override_preset: Optional[str] = Field(
None,
description=(
"Select a sampler override preset (default: None).\n"
"Select a sampler override preset (default: safe_defaults).\n"
"Find this in the sampler-overrides folder.\n"
"This overrides default fallbacks for sampler values "
"that are passed to the API."
"that are passed to the API.\n"
"NOTE: safe_defaults preset provides a fallback for frontends "
"that do not pass sampling params.\n"
"Remove it if not necessary."
),
)