theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-25 16:59:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
92ea7ee7cd1b56b48df10a1391bfd797173f15cb
tabbyAPI/backends/exllamav2/grammar.py
DocShotgun 7f899734c0 Grammar: Cache the engine vocabulary 
* Avoid rebuilding the KBNF engine vocabulary on every grammar-enabled request
2024-12-05 21:36:37 -08:00

4.7 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink