theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

API: Don't include draft directory in response

Browse Source 
The draft directory should be returned for a draft model request (TBD).

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2023-11-23 00:07:56 -05:00
parent 13c9c09398
commit d47c39da54
3 changed files with 19 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
model.py
View File

@@ -82,7 +82,7 @@ class ModelContainer:
self.config.max_input_len = chunk_size
self.config.max_attn_size = chunk_size ** 2
draft_config = kwargs.get("draft") or {}
draft_config = kwargs.get("draft") or {}
draft_model_name = draft_config.get("draft_model_name")
enable_draft = bool(draft_config) and draft_model_name is not None