kingbri 5c082b7e8c Async: Add option to use Uvloop/Winloop ...

These are faster event loops for asyncio which should improve overall
performance. Gate these under an experimental flag for now to stress
test these loops.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-07-24 18:59:20 -04:00

..

args.py

Async: Add option to use Uvloop/Winloop

2024-07-24 18:59:20 -04:00

auth.py

Auth: Fix key check coalesce

2024-07-19 10:08:57 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config.py

API: Add request logging

2024-07-22 21:40:00 -04:00

downloader.py

Downloader: Make timeout configurable

2024-07-23 21:42:38 -04:00

gen_logging.py

API: Add ability to use request IDs

2024-07-21 21:01:05 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

OAI: Migrate model depends into proper file

2024-07-23 13:59:56 -04:00

networking.py

API: Add request logging

2024-07-22 21:40:00 -04:00

sampling.py

Tree: Swap from map to list comprehensions

2024-05-25 21:16:14 -04:00

signals.py

Signal: Fix signal handlers for uvicorn

2024-03-16 23:23:31 -04:00

templating.py

Templates: Migrate to class

2024-04-21 23:28:14 -04:00

transformers_utils.py

Tree: Add transformers_utils

2024-04-20 00:07:39 -04:00

utils.py

Sampling: Copy over iterable overrides

2024-05-17 21:38:28 -04:00