kingbri 9390d362dd Model: Log generation params and metrics after the prompt/response ...

A user's prompt and response can be large in the console. Therefore,
always log the smaller payloads (ex. gen params + metrics) after
the large chunks.

However, it's recommended to keep prompt logging off anyways since
it'll result in console spam.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-08-01 00:19:21 -04:00

..

grammar.py

Model: Grammar: Fix lru_cache clear function

2024-07-08 15:10:15 -04:00

model.py

Model: Log generation params and metrics after the prompt/response

2024-08-01 00:19:21 -04:00

utils.py

Dependencies: Bump ExllamaV2

2024-07-11 14:22:50 -04:00