kingbri 1a331afe3a OAI: Add cache_mode parameter to model ...

Mistakenly forgot that the user can choose what cache mode to use
when loading a model.

Also add when fetching model info.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-16 02:47:50 -05:00

..

chat_completion.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

common.py

OAI: Remove unused parameters

2023-12-15 14:56:43 -05:00

completion.py

Adding token usage support

2023-11-27 20:05:05 -08:00

lora.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

model.py

OAI: Add cache_mode parameter to model

2023-12-16 02:47:50 -05:00

token.py

Api: Add ban_eos_token and add_bos_token support

2023-11-15 00:55:15 -05:00