kingbri bee26a2f2c API: Auto-unload on a load request ...

Automatically unload the existing model when calling /load. This was
requested many times, and does make more sense in the long run.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-21 23:00:11 -05:00

..

model.py

API: Auto-unload on a load request

2024-02-21 23:00:11 -05:00

utils.py

Requirements: Update Exllamav2

2024-02-14 21:51:25 -05:00