theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b74603db59ee99712439a38da2550ab692eec52d
tabbyAPI/backends
History
kingbri b74603db59 Model: Log metrics before yielding a stop 
Yielding the finish reason before the logging causes the function to
terminate early. Instead, log before yielding and breaking out of the
generation loop.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-03-20 01:17:04 -04:00
..
exllamav2
Model: Log metrics before yielding a stop
2024-03-20 01:17:04 -04:00