kingbri 46ac3beea9 Templates: Support list style chat_template keys ...

HuggingFace updated transformers to provide templates in a list for
tokenizers. Update to support this new format. Providing the name
of a template for the "prompt_template" value in config.yml will also
look inside the template list.

In addition, log if there's a template exception, but continue model
loading since it shouldn't shut down the application.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-07 11:20:25 -04:00

..

grammar.py

Model: Prompt users to install extras if dependencies don't exist

2024-03-22 22:13:55 -04:00

model.py

Templates: Support list style chat_template keys

2024-04-07 11:20:25 -04:00

utils.py

Model: Fix log if exl2 version is too low

2024-03-31 23:11:21 -04:00