theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-30 11:11:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

API: Add default for backend in model load request

Browse Source 
Should be None so pydantic doesn't complain.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-05-12 09:39:34 -04:00
parent b555eeb6e7
commit 8996dc7b02
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
endpoints/core/types/model.py
View File

@@ -83,6 +83,7 @@ class ModelLoadRequest(BaseModel):
# Config arguments # Config arguments
backend: Optional[str] = Field( backend: Optional[str] = Field(
description="Backend to use", description="Backend to use",
default=None,
) )
max_seq_len: Optional[int] = Field( max_seq_len: Optional[int] = Field(
description="Leave this blank to use the model's base sequence length", description="Leave this blank to use the model's base sequence length",