theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-20 14:28:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Fix dynatemp fallback

Browse Source 
Set to 1.0 if the condition fails.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-02-10 12:02:31 -05:00
parent 17636ed899
commit 8d8cf5dc69
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
backends/exllamav2/model.py
View File

@@ -634,8 +634,8 @@ class ExllamaV2Container:
gen_settings.temp_exponent = unwrap(kwargs.get("temp_exponent"), 1.0)
else:
# Force to default values
gen_settings.max_temp = 0.0
gen_settings.min_temp = 0.0
gen_settings.max_temp = 1.0
gen_settings.min_temp = 1.0
gen_settings.temp_exponent = 1.0
# Warn if max/min temp values are > 0