kingbri db87efde4a OAI: Add ability to specify fastchat prompt template ...

Sometimes fastchat may not be able to detect the prompt template from
the model path. Therefore, add the ability to set it in config.yml or
via the request object itself.

Also send the provided prompt template on model info request.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-10 15:43:58 -05:00

20 KiB

Raw Blame History

View Raw