kingbri 43f9483bc4 Model: Add tensor_parallel_backend option ...

This allows for users to use nccl or native depending on the GPU setup.
NCCL is only available with Linux built wheels.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-08-17 22:35:10 -04:00

..

model.py

Model: Add tensor_parallel_backend option

2025-08-17 22:35:10 -04:00

sampler.py

Model: Add Exllamav3 sampler

2025-05-02 21:33:25 -04:00

vision.py

Exl3: Add vision capability

2025-06-15 19:22:51 +02:00