theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
707d005aad8f9391a25ca6198e76f4ea9d63e93b
tabbyAPI/common/gen_logging.py
kingbri 2913ce29fc API: Add timings to usage stats 
It's useful for the client to know what the T/s and total time for
generation are per-request.

Works with both completions and chat completions.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-06-17 22:54:51 -04:00

2.6 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink