theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-20 06:19:15 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Set vision load to False by default

Browse Source 
Mistake in unwrapping. Vision should be false to allow normal model
loading when the flag isn't provided.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-11-21 17:54:42 -05:00
parent 902045edbb
commit 0ab393f09c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backends/exllamav2/model.py
View File

@@ -152,7 +152,7 @@ class ExllamaV2Container:
kwargs = await self.set_model_overrides(**kwargs)
# Set vision state
self.use_vision = unwrap(kwargs.get("vision"), True)
self.use_vision = unwrap(kwargs.get("vision"), False)
# Prepare the draft model config if necessary
draft_args = unwrap(kwargs.get("draft_model"), {})