kingbri 05c3f1194f Sampling: Add rudimentary DRY support ...

Adds DRY support based on the current exl2 dev API. Only change for
optimization is dry_max_ngram instead of using a closed range.

Currently, DRY range is aliased to dry_max_ngram.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-07 00:48:42 -04:00

..

args.py

Config: Use an explicit "auto" value for rope_alpha

2024-08-31 22:59:56 -04:00

auth.py

Auth: Fix disable auth when checking for key permissions

2024-07-26 15:04:29 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

downloader.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

gen_logging.py

Model: Attach request ID to logs

2024-08-01 00:25:54 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

networking.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00

sampling.py

Sampling: Add rudimentary DRY support

2024-09-07 00:48:42 -04:00

signals.py

Model: Bypass lock checks when shutting down

2024-08-03 16:05:34 -04:00

tabby_config.py

Config: Format and organize

2024-09-05 17:59:18 -04:00

templating.py

Templates: Switch to async jinja engine

2024-08-17 12:03:41 -04:00

transformers_utils.py

Tree: Format

2024-07-26 18:33:04 -04:00

utils.py

Config: Migrate to global class instead of dicts

2024-09-04 23:18:47 -04:00