theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-21 06:48:56 +00:00
Code Issues Packages Projects Releases Wiki Activity

Config: Enable safe sampler overrides by default

Browse Source 
* Provides safe fallback samplers, intended for better out-of-the-box support for clients that do not pass sampler params
This commit is contained in:
DocShotgun
2025-08-18 12:32:28 -07:00
parent a4d02c2b70
commit 998abe5ad1
4 changed files with 20 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
config_sample.yml
View File

@@ -208,10 +208,12 @@ embeddings:
# Options for Sampling
sampling:
# Select a sampler override preset (default: None).
# Select a sampler override preset (default: safe_defaults).
# Find this in the sampler-overrides folder.
# This overrides default fallbacks for sampler values that are passed to the API.
override_preset:
# NOTE: safe_defaults preset provides a fallback for frontends that do not pass sampling params.
# Remove it if not necessary.
override_preset: safe_defaults
# Options for development and experimentation
developer: