kingbri e00eb09ef3 OAI: Add cancellation with inline load ...

When the request is cancelled, cancel the load task. In addition,
when checking if a model container exists, also check if the model
is fully loaded.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-11 00:08:55 -04:00

..

chat_completion.py

Remove rouge print statements within chat_completion.py (#174)

2024-08-23 21:28:37 -04:00

completion.py

OAI: Add cancellation with inline load

2024-09-11 00:08:55 -04:00

embeddings.py

Embeddings: Migrate and organize Infinity

2024-07-30 11:00:23 -04:00