kingbri 6bb5f8f599 Sampling: Rewrite mirostat_mode parameter ...

Apparently the "mirostat" parameter has been updated by frontends
to pass a number. ExllamaV2 expects a boolean, but most pass a number
anyway, so just alias mirostat_mode and mirostat together.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-04-16 02:13:55 -04:00

..

grammar.py

Grammar: Cache the engine vocabulary

2024-12-05 21:36:37 -08:00

model.py

Sampling: Rewrite mirostat_mode parameter

2025-04-16 02:13:55 -04:00

utils.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

version.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

vision.py

Dependencies: Fix OpenAPI generation

2024-11-22 17:59:20 -05:00