kingbri eadc71a4c3 Model: Add unload and error messages for vision ...

If vision is enabled and the model doesn't support it, send an
error asking the user to reload. Also, add a method to unload the
vision tower.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-11-22 14:25:03 -05:00

..

grammar.py

Grammar: Add custom ExLlamaV2TokenEnforcerFilter class

2024-09-14 21:42:53 +02:00

model.py

Model: Add unload and error messages for vision

2024-11-22 14:25:03 -05:00

utils.py

fix issues with optional dependencies (#204)

2024-09-19 22:24:55 -04:00

version.py

Dependencies: Update ExllamaV2

2024-09-30 00:17:12 -04:00

vision.py

Config: Add option to disable fetching content from URLs

2024-11-17 23:05:17 -08:00