theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Tree: Format

Browse Source
This commit is contained in:
DocShotgun
2024-12-17 09:37:33 -08:00
parent 5da335eb3d
commit 4d11323c17
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backends/exllamav2/model.py
View File

@@ -1315,7 +1315,7 @@ class ExllamaV2Container:
self.config.max_seq_len - max(context_len, negative_context_len),
)
if max_tokens < 1:
logger.warning("max_tokens must be a positive integer, " "setting to 1.")
logger.warning("max_tokens must be a positive integer, setting to 1.")
max_tokens = 1
# Check total length of request