mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-15 00:07:28 +00:00
Config: Remove developement flag from tensor parallel
Exists in stable ExllamaV2 version. Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
@@ -112,7 +112,6 @@ model:
|
||||
# Load model with tensor parallelism
|
||||
# If a GPU split isn't provided, the TP loader will fallback to autosplit
|
||||
# Enabling ignores the gpu_split_auto and autosplit_reserve values
|
||||
# NOTE: Requires a development build of exllamav2
|
||||
#tensor_parallel: False
|
||||
|
||||
# Automatically allocate resources to GPUs (default: True)
|
||||
|
||||
Reference in New Issue
Block a user