kingbri aa657fa6e9 API: Ignore add_bos_token in chat completions ...

When fetching special tokens from the model, don't factor in the
add_bos_token and ban_eos_token parameters as switches.

In addition, change the internal handling of add_bos_token to an optional
boolean. This allows us to fallback to the model when selecting whether
or not to add the BOS token, especially for chat completions.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-05-01 22:51:15 -04:00

..

core

Tree: Format + Lint

2025-04-26 02:14:30 -04:00

Kobold

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

OAI

API: Ignore add_bos_token in chat completions

2025-05-01 22:51:15 -04:00

server.py

Args: Expose api-servers to subcommands

2025-02-10 23:39:46 -05:00