kingbri bfa011e0ce Embeddings: Add model management ...

Embedding models are managed on a separate backend, but are run
in parallel with the model itself. Therefore, manage this in a separate
container with separate routes.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-07-30 15:19:27 -04:00

..

args.py

Async: Add option to use Uvloop/Winloop

2024-07-24 18:59:20 -04:00

auth.py

Auth: Fix key check coalesce

2024-07-19 10:08:57 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config.py

Embeddings: Switch to Infinity

2024-07-29 13:42:03 -04:00

downloader.py

Downloader: Make timeout configurable

2024-07-23 21:42:38 -04:00

gen_logging.py

API: Add ability to use request IDs

2024-07-21 21:01:05 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

Embeddings: Add model management

2024-07-30 15:19:27 -04:00

networking.py

API: Add request logging

2024-07-22 21:40:00 -04:00

sampling.py

Tree: Swap from map to list comprehensions

2024-05-25 21:16:14 -04:00

signals.py

Signal: Fix async signal handling

2024-07-30 11:11:05 -04:00

templating.py

Templates: Migrate to class

2024-04-21 23:28:14 -04:00

transformers_utils.py

Tree: Add transformers_utils

2024-04-20 00:07:39 -04:00

utils.py

Sampling: Copy over iterable overrides

2024-05-17 21:38:28 -04:00