turboderp 92ea7ee7cd Model: Add draft model/speculative decoding

2025-05-04 01:27:42 +02:00

..

exllamav2

Model: Fetch from generation_config and tokenizer_config in Exl3

2025-05-02 21:33:25 -04:00

exllamav3

Model: Add draft model/speculative decoding

2025-05-04 01:27:42 +02:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

Model: Add exl3 and associated load functions

2025-05-02 21:32:39 -04:00