theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Grammar: Fix lru_cache clear function

Browse Source 
It's cache_clear not clear_cache.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-07-08 15:10:15 -04:00
parent 17438288c7
commit 62e495fc13
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backends/exllamav2/grammar.py
View File

@@ -64,7 +64,7 @@ def clear_grammar_func_cache():
"""Flush tokenizer_data cache to avoid holding references to
tokenizers after unloading a model"""
_get_lmfe_tokenizer_data.clear_cache()
_get_lmfe_tokenizer_data.cache_clear()
class ExLlamaV2Grammar: