mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-05-11 16:30:16 +00:00
Rework how max_seq_len is determined from user settings, model defaults and cache size constraint
Rework how max_seq_len is determined from user settings, model defaults and cache size constraint