kingbri 084916c04f Model: Fix autosplit reserve crash with GPU split ...

ExllamaV3 does not accept autosplit_reserve and gpu_split at the same
time.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-05-17 00:51:14 -04:00

..

exllamav2

Tree: Format

2025-05-17 00:46:40 -04:00

exllamav3

Model: Fix autosplit reserve crash with GPU split

2025-05-17 00:51:14 -04:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

Model: Create universal HFModel class

2025-05-13 18:12:38 -04:00