theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-30 11:11:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Fix override application

Browse Source 
None values weren't being excluded on initial load when dumping.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-09-30 00:41:23 -04:00
parent 126a44483c
commit f20857cb34
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
main.py
View File

@@ -69,8 +69,8 @@ async def entrypoint_async():
# TODO: remove model_dump() # TODO: remove model_dump()
await model.load_model( await model.load_model(
model_path.resolve(), model_path.resolve(),
**config.model.model_dump(), **config.model.model_dump(exclude_none=True),
draft=config.draft_model.model_dump(), draft=config.draft_model.model_dump(exclude_none=True),
) )
# Load loras after loading the model # Load loras after loading the model