theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-20 06:19:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
72b08624a39e097d5aaeee549cc27ceaf80c40c3
tabbyAPI/backends
History
kingbri b74603db59 Model: Log metrics before yielding a stop 
Yielding the finish reason before the logging causes the function to
terminate early. Instead, log before yielding and breaking out of the
generation loop.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-03-20 01:17:04 -04:00
..
exllamav2
Model: Log metrics before yielding a stop
2024-03-20 01:17:04 -04:00