turboderp 0d949d00b9 Model: Set default max_batch_size

2025-05-03 18:33:37 +02:00

..

exllamav2

Model: Fetch from generation_config and tokenizer_config in Exl3

2025-05-02 21:33:25 -04:00

exllamav3

Model: Set default max_batch_size

2025-05-03 18:33:37 +02:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

Model: Add exl3 and associated load functions

2025-05-02 21:32:39 -04:00