Sampling: Remove skip_special_tokens

This parameter is way too confusing and does not make sense in
the modern LLM space.

Change approved by all maintainers.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-05-09 22:11:05 -04:00
parent 25c77ebf77
commit 42346c6b39
3 changed files with 0 additions and 9 deletions

View File

@@ -136,9 +136,6 @@ add_bos_token:
ban_eos_token:
override: false
force: false
skip_special_tokens:
override: true
force: false
logit_bias:
override:
force: false