theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
10d9419f908321f5fdc9c9054a41ad187f37256f
tabbyAPI/backends/exllamav2/model.py
kingbri 10d9419f90 Model: Add BOS token to prompt logs 
If add_bos_token is enabled, the BOS token gets appended to the logged
prompt if logging is enabled.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-08-29 21:15:09 -04:00

48 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink