kingbri 2d89c96879 API: Re-add BOS token stripping in template render ...

Matching YALS, if the model has add_bos_token enabled, then remove
an extra BOS token at the start of the prompt. This usually happens
with misconfigured templates such as Llama 3.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-05-24 21:11:53 -04:00

..

core

API: Add default for backend in model load request

2025-05-12 09:51:09 -04:00

Kobold

Tree: Format

2025-05-17 00:46:40 -04:00

OAI

API: Re-add BOS token stripping in template render

2025-05-24 21:11:53 -04:00

server.py

Args: Expose api-servers to subcommands

2025-02-10 23:39:46 -05:00