theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-27 01:38:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c9a6d9ae1fe9ee55de8420daa62464a6b573531c
tabbyAPI/backends/exllamav2/model.py
kingbri c9a6d9ae1f Model: Switch to begin_stream_ex 
Allows for dynamically passing logprobs params instead of assuming
on initialization of the generator.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-03-17 14:41:16 -04:00

38 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink