turboderp-org/exllamav2
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav2.git synced 2026-03-15 00:07:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix small mistake in example

Browse Source
This commit is contained in:
turboderp
2024-02-19 14:20:17 +01:00
committed by GitHub
parent 229019d86e
commit c8e2bf4594
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/lm_format_enforcer.py
View File

@@ -60,7 +60,7 @@ def completion(prompt, filters = None, max_new_tokens = 200, eos_bias = False):
# If using a filter, sample the EOS token as soon as filter allows it
if len(filters) > 0: settings.filter_prefer_eos = True
settings.filter_prefer_eos = eos_bias
# Send prompt to generator to begin stream