theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-26 01:08:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
9f649647f0efd0aabf3ee2de9f00db2bde410f83
tabbyAPI/backends/exllamav2/grammar.py
DocShotgun 7f899734c0 Grammar: Cache the engine vocabulary 
* Avoid rebuilding the KBNF engine vocabulary on every grammar-enabled request
2024-12-05 21:36:37 -08:00

4.7 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink