kingbri 7bf2b07d4c Signals: Exit on async cleanup ...

The async signal exit function should be the internal for exiting
the program. In addition, prevent the handler from being called
twice by adding a boolean. May become an asyncio event later on.

In addition, make sure to skip_wait when running model.unload.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-08-02 15:11:57 -04:00

..

args.py

Embeddings: Update config, args, and parameter names

2024-07-30 15:32:26 -04:00

auth.py

Auth: Fix disable auth when checking for key permissions

2024-07-26 15:04:29 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config.py

Embeddings: Update config, args, and parameter names

2024-07-30 15:32:26 -04:00

downloader.py

Downloader: Make timeout configurable

2024-07-23 21:42:38 -04:00

gen_logging.py

Model: Attach request ID to logs

2024-08-01 00:25:54 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

Config: Embeddings: Make embeddings_device a default when API loading

2024-08-01 13:59:49 -04:00

networking.py

API: Add request logging

2024-07-22 21:40:00 -04:00

sampling.py

Tree: Format

2024-07-26 18:33:04 -04:00

signals.py

Signals: Exit on async cleanup

2024-08-02 15:11:57 -04:00

templating.py

Templates: Migrate to class

2024-04-21 23:28:14 -04:00

transformers_utils.py

Tree: Format

2024-07-26 18:33:04 -04:00

utils.py

Model: Add support for HuggingFace config and bad_words_ids

2024-07-26 18:23:22 -04:00