theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-30 03:01:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

API: Add allowed_tokens support

Browse Source 
This is the opposite of banned tokens. Exllama specific implementation
of #181.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-08-29 21:37:55 -04:00
parent 10d9419f90
commit 21712578cf
3 changed files with 25 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
sampler_overrides/sample_preset.yml
View File

@@ -126,6 +126,10 @@ banned_tokens:
override: []
force: false
additive: false
allowed_tokens:
override: []
force: false
additive: false
# MARK: CFG scale
cfg_scale: