kingbri 46ac3beea9 Templates: Support list style chat_template keys ...

HuggingFace updated transformers to provide templates in a list for
tokenizers. Update to support this new format. Providing the name
of a template for the "prompt_template" value in config.yml will also
look inside the template list.

In addition, log if there's a template exception, but continue model
loading since it shouldn't shut down the application.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-07 11:20:25 -04:00

..

args.py

Tree: Format

2024-03-13 00:02:55 -04:00

auth.py

API: Cleanup permission endpoint

2024-03-18 15:13:26 -04:00

concurrency.py

API: Fix blocking iterator execution

2024-03-16 23:23:31 -04:00

config.py

Tree: Update to cleanup globals

2024-03-12 23:59:30 -04:00

gen_logging.py

Tree: Format

2024-03-13 23:33:18 -04:00

logger.py

ruff

2024-04-01 23:11:30 +00:00

model.py

Common: Migrate request utils to networking

2024-03-21 23:21:57 -04:00

networking.py

Common: Migrate request utils to networking

2024-03-21 23:21:57 -04:00

sampling.py

Sampling: Add additive param to overrides

2024-03-31 01:10:55 -04:00

signals.py

Signal: Fix signal handlers for uvicorn

2024-03-16 23:23:31 -04:00

templating.py

Templates: Support list style chat_template keys

2024-04-07 11:20:25 -04:00

utils.py

Common: Migrate request utils to networking

2024-03-21 23:21:57 -04:00