mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-05-12 16:55:50 +00:00
Rework how max_seq_len is determined from user settings, model defaults and cache size constraint
Rework how max_seq_len is determined from user settings, model defaults and cache size constraint