kingbri fdb86f4c63 ExllamaV2: Add max_seq_len empty case like ExllamaV3 ...

Also remove the intermediate base_seq_len and target_seq_len variables
to make code clearer.

If paged mode is off, max_seq_len becomes the prime mover since batching
is unavailable.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-10-14 23:02:52 -04:00

..

exllamav2

ExllamaV2: Add max_seq_len empty case like ExllamaV3

2025-10-14 23:02:52 -04:00

exllamav3

ExllamaV3: Handle max_seq_len defined and cache_size undefined case

2025-10-14 21:48:36 -04:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

Model: Create universal HFModel class

2025-05-13 18:12:38 -04:00