theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-21 23:09:13 +00:00
Code Issues Packages Projects Releases Wiki Activity

API: Fix CFG reporting

Browse Source 
THe model endpoint wasn't reporting if CFG is on.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-01-02 13:54:16 -05:00
parent bbd4ee54ca
commit 6b04463051
3 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
OAI/types/model.py
View File

@@ -18,6 +18,7 @@ class ModelCardParameters(BaseModel):
cache_mode: Optional[str] = "FP16"
prompt_template: Optional[str] = None
num_experts_per_token: Optional[int] = None
use_cfg: Optional[bool] = None
draft: Optional["ModelCard"] = None