kingbri 69a25d7fa6 Config + Endpoints: Make cache_size more prominent ...

Since cache_size is a more important parameter now for multi-user
setups, mark it as such by placing it below max_seq_len.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-10-14 21:53:33 -04:00

..

types

Config + Endpoints: Make cache_size more prominent

2025-10-14 21:53:33 -04:00

utils

API + Model: Fix application of defaults

2025-07-03 14:37:34 -04:00

router.py

API + Model: Fix application of defaults

2025-07-03 14:37:34 -04:00