kingbri 10d9419f90 Model: Add BOS token to prompt logs ...

If add_bos_token is enabled, the BOS token gets appended to the logged
prompt if logging is enabled.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-08-29 21:15:09 -04:00

..

grammar.py

Model: Grammar: Fix lru_cache clear function

2024-07-08 15:10:15 -04:00

model.py

Model: Add BOS token to prompt logs

2024-08-29 21:15:09 -04:00

utils.py

Dependencies: Update Exllamav2

2024-08-22 14:15:19 -04:00