kingbri e00eb09ef3 OAI: Add cancellation with inline load ...

When the request is cancelled, cancel the load task. In addition,
when checking if a model container exists, also check if the model
is fully loaded.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-11 00:08:55 -04:00

..

core

API + Model: Apply config.yml defaults for all load paths

2024-09-10 23:35:35 -04:00

Kobold

API: Bump sent koboldcpp version

2024-09-07 21:45:51 -04:00

OAI

OAI: Add cancellation with inline load

2024-09-11 00:08:55 -04:00

server.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

utils.py

Main: Make openapi export store locally

2024-07-08 14:54:06 -04:00