kingbri 6f9da97114 API: Add banned_tokens ...

Appends the banned tokens to the generation. This is equivalent of
setting logit bias to -100 on a specific set of tokens.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-28 11:06:09 -04:00

..

args.py

Tree: Format

2024-03-13 00:02:55 -04:00

auth.py

API: Cleanup permission endpoint

2024-03-18 15:13:26 -04:00

concurrency.py

API: Fix blocking iterator execution

2024-03-16 23:23:31 -04:00

config.py

Tree: Update to cleanup globals

2024-03-12 23:59:30 -04:00

gen_logging.py

Tree: Format

2024-03-13 23:33:18 -04:00

logger.py

ruff

2024-04-01 23:11:30 +00:00

model.py

Common: Migrate request utils to networking

2024-03-21 23:21:57 -04:00

networking.py

Network: Fix socket check timeout

2024-04-22 21:33:41 -04:00

sampling.py

API: Add banned_tokens

2024-04-28 11:06:09 -04:00

signals.py

Signal: Fix signal handlers for uvicorn

2024-03-16 23:23:31 -04:00

templating.py

Templates: Migrate to class

2024-04-21 23:28:14 -04:00

transformers_utils.py

Tree: Add transformers_utils

2024-04-20 00:07:39 -04:00

utils.py

Common: Migrate request utils to networking

2024-03-21 23:21:57 -04:00