kingbri 05c3f1194f Sampling: Add rudimentary DRY support ...

Adds DRY support based on the current exl2 dev API. Only change for
optimization is dry_max_ngram instead of using a closed range.

Currently, DRY range is aliased to dry_max_ngram.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-09-07 00:48:42 -04:00

..

grammar.py

Model: Grammar: Fix lru_cache clear function

2024-07-08 15:10:15 -04:00

model.py

Sampling: Add rudimentary DRY support

2024-09-07 00:48:42 -04:00

utils.py

Dependencies: Update Exllamav2

2024-08-22 14:15:19 -04:00