theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-05-11 16:30:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
06ff47e2b4c863675711c4f3289e6cc7f0dd8ecc
tabbyAPI/backends
History
kingbri 06ff47e2b4 Model: Use true async jobs and add logprobs 
The new async dynamic job allows for native async support without the
need of threading. Also add logprobs and metrics back to responses.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-25 21:16:14 -04:00
..
exllamav2
Model: Use true async jobs and add logprobs
2024-05-25 21:16:14 -04:00