theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
43f9483bc435083fc3751e664c14f2eb6acb6ad2
tabbyAPI/common/config_models.py
kingbri 43f9483bc4 Model: Add tensor_parallel_backend option 
This allows for users to use nccl or native depending on the GPU setup.
NCCL is only available with Linux built wheels.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-08-17 22:35:10 -04:00

16 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink