kingbri a14abfe21c Templates: Support bos_token and eos_token fields ...

These are commonly seen in huggingface provided chat templates and
aren't that difficult to add in.

For feature parity, honor the add_bos_token and ban_eos_token
parameters when constructing the prompt.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-22 10:33:11 -05:00

24 KiB

Raw Blame History

View Raw