kingbri 1a331afe3a OAI: Add cache_mode parameter to model ...

Mistakenly forgot that the user can choose what cache mode to use
when loading a model.

Also add when fetching model info.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-16 02:47:50 -05:00

..

types

OAI: Add cache_mode parameter to model

2023-12-16 02:47:50 -05:00

utils.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00