theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

fixup: autosplit reserve

Browse Source 
this probably breaks v2 support
This commit is contained in:
randoentity
2025-04-30 09:43:33 +02:00
committed by kingbri
parent acb3adb953
commit 306fc7cd15
2 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/config_models.py
View File

@@ -193,7 +193,7 @@ class ModelConfig(BaseConfigModel):
"Not parsed for single GPU users."
),
)
autosplit_reserve: List[int] = Field(
autosplit_reserve: List[float] = Field(
[96],
description=(
"Reserve VRAM used for autosplit loading (default: 96 MB on GPU 0).\n"