kingbri a96fa5f138 API: Don't fallback to default values on model load request ...

It's best to pass them down the config stack.

API/User config.yml -> model config.yml -> model config.json -> fallback.

Doing this allows for seamless flow and yielding control to each
member in the stack.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-08-31 22:59:56 -04:00

..

grammar.py

Model: Grammar: Fix lru_cache clear function

2024-07-08 15:10:15 -04:00

model.py

API: Don't fallback to default values on model load request

2024-08-31 22:59:56 -04:00

utils.py

Dependencies: Update Exllamav2

2024-08-22 14:15:19 -04:00