kingbri 083df7d585 Tree: Add generation logging support ...

Generations can be logged in the console along with sampling parameters
if the user enables it in config.

Metrics are always logged at the end of each prompt. In addition,
the model endpoint tells the user if they're being logged or not
for transparancy purposes.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-12 23:43:35 -05:00

..

chat_completion.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

common.py

Tree: Use unwrap and coalesce for optional handling

2023-12-09 21:52:17 -05:00

completion.py

Adding token usage support

2023-11-27 20:05:05 -08:00

lora.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

model.py

Tree: Add generation logging support

2023-12-12 23:43:35 -05:00

token.py

Api: Add ban_eos_token and add_bos_token support

2023-11-15 00:55:15 -05:00