kingbri 303e2dde12 Model: Correct exl3 generation, add concurrency, and cleanup ...

Fixes application of sampler parameters by adding a new sampler builder
interface. Also expose the generator class-wide and add wait_for_jobs.

Finally, allow inline loading to specify the backend.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-05-02 21:33:25 -04:00

..

exllamav2

Exl3: Couldn't wait

2025-05-02 21:33:25 -04:00

exllamav3

Model: Correct exl3 generation, add concurrency, and cleanup

2025-05-02 21:33:25 -04:00

infinity

Model: Add proper jobs cleanup and fix var calls

2025-04-24 21:30:55 -04:00

base_model_container.py

Model: Add exl3 and associated load functions

2025-05-02 21:32:39 -04:00