DocShotgun f8070e7707 Model: Auto detect model backend from config ...

* Use exllamav3 for exl3 models, exllamav2 otherwise

2025-05-06 18:51:58 -07:00

..

types

Model: Auto detect model backend from config

2025-05-06 18:51:58 -07:00

utils

API: Ignore add_bos_token in chat completions

2025-05-01 22:51:15 -04:00

router.py

API: Fix chat completion formatting flow

2024-11-21 17:51:14 -05:00