theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
69a25d7fa66ec0bd69fc04d31656e836f4cd4624
tabbyAPI/common/config_models.py
kingbri 69a25d7fa6 Config + Endpoints: Make cache_size more prominent 
Since cache_size is a more important parameter now for multi-user
setups, mark it as such by placing it below max_seq_len.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-10-14 21:53:33 -04:00

16 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink